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(54) IMAGE PROCESSING METHOD AND UNIT, AND RECORDING MEDIUM 
(57)Abstract* 

PROBLEM TO BE SOLVED* To provide an image processing unit that can reduce an 
arithmetic amount for calculating a weighting coefficient in the case of estimating a 
signal value at all pixel positions by applying weight summing to a signal estimate 
value in a prescribed direction and a direction orthogonal to the prescribed direction as 
to image data obtained by an image pickup device such as a single board CCD. 
SOLUTION: A 1st interpolation means 11 calculates a signal value Ql in a prescribed 
direction and a 2nd interpolation means 12 calculates a signal value Q2 as to a direction 
orthogonal to the prescribed direction. A fluctuation value calculation means 13 
calculates fluctuations of the signal value at a pixel position to calculate a signal value 
in the prescribed direction and the direction orthogonal to the prescribed direction as 



fluctuation values SA, SB. A memory 14 stores cross-references of the fluctuation values 
SA, SB with respect to weighting coefficients, and a weighting coefficient selection 
means 14 references the memory 14A to select a weighting coefficient Sj. A weight sum 
means 15 applies weight summing to the signals Ql, Q2 by "using the selected weighting 
coefficient Sj to obtain R, B signals QR, QB. 
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CLAIMS 



[Claim(s)] 

[Claim 1] It is the image pickup device with which the 1st to 3rd [ which has different 
spectral sensitivity ] optoelectric transducer has been arranged on a single side, and the 
image pick-up side was formed. Arrange said the 1st and said 2nd optoelectric 
transducer by turns in the predetermined direction, and the 1st line is formed. Arrange 
said the 1st and said 3rd optoelectric transducer by turns in said predetermined 



direction, and the 2nd line is formed, the rectangular direction which intersects 
perpendicularly with said predetermined direction - setting said the 1st and said 2nd 
optoelectric transducer - alternation - and so that said the 1st and said 3rd optoelectric 
transducer may be arranged by turns By arranging the 1st and said said 2nd line by 
turns in said rectangular direction It is based on the 1st to 3rd [ which was obtained in 
the image pickup device with which said image pick-up side which consists of the 1st to 
3rd pixel was formed ] signal value. In the image-processing approach of presuming at 
least one signal value among the said 1st [ the ] in total pixel location to 3rd signal 
values The rectangular direction estimate which is the estimate of the predetermined 
direction estimate which is the estimate of the signal value about said predetermined 
direction, and the signal value about said rectangular direction is computed. The 
rectangular direction variation showing the amount of fluctuation of the predetermined 
direction variation showing the amount of fluctuation of the signal value about said 
predetermined direction and the signal value about said rectangular direction is 
computed. The ratio of said predetermined direction variation to the aggregate value of 
said predetermined direction variation and said rectangular direction variation, or said 
rectangular direction variation Said predetermined direction estimate and said 
rectangular direction estimate are faced computing as a weighting multiplier at the 
time of carrying out weighting addition. It is based on the relation between said 
predetermined direction variation at the time of presupposing that said weighting 
multiplier is fixed, and said rectangular direction variation. The storage means which 
computed beforehand the correspondence relation between the predetermined direction 
variation to two or more weighting multipliers and the rectangular direction variation, 
and memorized it is referred to. Based on the weighting multiplier of 1, weighting 
addition of said predetermined direction estimate and said rectangular direction 
estimate is carried out. said predetermined direction variation and said rectangular 
direction variation - being based - the weighting multiplier of said two or more 
weighting multipliers to 1 - choosing - this - The image -processing approach 
characterized by presuming at least one signal value among said the 1st to 3rd signal 
values. 

[Claim 2] The image-processing approach according to claim 1 that said two or more 
weighting multipliers in said correspondence relation memorized by said storage means 
are characterized by being set up, becoming so that the ratio of said predetermined 
direction variation to said aggregate value or said rectangular direction variation may 
be set to l/2n (n is the natural number), and performing said weighting addition by the 
bit shift based on said weighting multiplier of selected 1. 



[Claim 3] It is the image pickup device with which the 1st to 3rd [ which has different 
spectral sensitivity ] optoelectric transducer has been arranged on a single side, and the 
image pick-up side was formed. Arrange said the 1st and said 2nd optoelectric 
transducer by turns in the predetermined direction, and the 1st line is formed. Arrange 
said the 1st and said 3rd optoelectric transducer by turns in said predetermined 
direction, and the 2nd line is formed, the rectangular direction which intersects 
perpendicularly with said predetermined direction - setting - said the 1st and said 2nd 
optoelectric transducer - alternation and so that said the 1st and said 3rd optoelectric 
transducer may be arranged by turns By arranging the 1st and said said 2nd line by 
turns in said rectangular direction It is based on the 1st to 3rd [ which was obtained in 
the image pickup device with which said image pick-up side which consists of the 1st to 
3rd pixel was formed ] signal value. In the image processing system which presumes at 
least one signal value among the said 1st [ the ] in total pixel location to 3rd signal 
values An estimate calculation means to compute the rectangular direction estimate 
which is the estimate of the predetermined direction estimate which is the estimate of 
the signal value about said predetermined direction, and the signal value about said 
rectangular direction, A variation calculation means to compute the rectangular 
direction variation showing the amount of fluctuation of the predetermined direction 
variation showing the amount of fluctuation of the signal value about said 
predetermined direction, and the signal value about said rectangular direction, The 
ratio of said predetermined direction variation to the aggregate value of said 
predetermined direction variation and said rectangular direction variation, or said 
rectangular direction variation Said predetermined direction estimate and said 
rectangular direction estimate are faced computing as a weighting multiplier at the 
time of carrying out weighting addition. Based on the relation between said 
predetermined direction variation at the time of presupposing that said weighting 
multiplier is fixed, and said rectangular direction variation, the correspondence relation 
between the predetermined direction variation to two or more weighting multipliers 
and the rectangular direction variation is computed beforehand. The storage means 
which memorized this relation, and a weighting multiplier selection means to choose 
the weighting multiplier of 1 from said two or more weighting multipliers with 
reference to said storage means based on said predetermined direction variation and 
said rectangular direction variation, this - the image processing system which carries 
out weighting addition of said predetermined direction estimate and said rectangular 
direction estimate, and is characterized by having a weighting addition means to 
presume at least one signal value among said the 1st to 3rd signal values based on the 



weighting multiplier of 1. 

[Claim 4] It is the image processing system according to claim 3 which is set up, 
becomes so that the ratio of said predetermined direction variation [ as opposed to said 
aggregate value in said two or more weighting multipliers in said correspondence 
relation memorized by said storage means ] or said rectangular direction variation may 
be set to l/2n (n is the natural number), and is characterized by for said weighting 
addition means to be a means to by_which the bit shift based on said weighting 
multiplier of selected 1 performs said weighting addition. 

[Claim 5] It is the image pickup device with which the 1st to 3rd [ which has different 
spectral sensitivity ] optoelectric transducer has been arranged on a single side, and the 
image pick-up side was formed. Arrange said the 1st and said 2nd optoelectric 
transducer by turns in the predetermined direction, and the 1st line is formed. Arrange 
said the 1st and said 3rd optoelectric transducer by turns in said predetermined 
direction, and the 2nd line is formed, the rectangular direction which intersects 
perpendicularly with said predetermined direction - setting - said the 1st and said 2nd 
optoelectric transducer - alternation - and so that said the 1st and said 3rd optoelectric 
transducer may be arranged by turns By arranging the 1st and said said 2nd line by 
turns in said rectangular direction It is based on the 1st to 3rd [ which was obtained in 
the image pickup device with which said image pick-up side which consists of the 1st to 
3rd pixel was formed ] signal value. In the record medium which recorded the program 
for making a computer perform the image-processing approach of presuming at least 
one signal value among the said 1st [ the ] in total pixel location to 3rd signal values and 
in which computer read is possible The procedure which computes the rectangular 
direction estimate which is the estimate of the predetermined direction estimate said 
whose program is the estimate of the signal value about said predetermined direction, 
and the signal value about said rectangular direction, The procedure which computes 
the rectangular direction variation showing the amount of fluctuation of the 
predetermined direction variation showing the amount of fluctuation of the signal value 
about said predetermined direction, and the signal value about said rectangular 
direction, The ratio of said predetermined direction variation to the aggregate value of 
said predetermined direction variation and said rectangular direction variation, or said 
rectangular direction variation Said predetermined direction estimate and said 
rectangular direction estimate are faced computing as a weighting multiplier at the 
time of carrying out weighting addition. It is based on the relation between said 
predetermined direction variation at the time of presupposing that said weighting 
multiplier is fixed, and said rectangular direction variation. The storage means which 



computed beforehand the correspondence relation between the predetermined direction 
variation to two or more weighting multipliers and the rectangular direction variation, 
and memorized it is referred to. The procedure which chooses the weighting multiplier 
of 1 from said two or more weighting multipliers based on said predetermined direction 
variation and said rectangular direction variation, this - the record medium which 
carries out weighting addition of said predetermined direction estimate and said 
rectangular direction estimate, and is characterized by having the procedure of 
presuming at least one signal value among said the 1st to 3rd signal values based on the 
weighting multiplier of 1 and in which computer read is possible. 

[Claim 6] The procedure it is set up and become so that the ratio of said predetermined 
direction variation [ as opposed to said aggregate value in two or more of said weighting 
multipliers in said correspondence relation memorized by said storage means ] or said 
rectangular direction variation may be set to l/2n ( n is the natural number), and 
perform said weighting addition is the record medium which is characterized by to be 
the procedure in_which of the bit shift based on said weighting multiplier of selected 1 
performs said weighting addition and in which computer read according to claim 5 is 
possible. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the record medium which recorded the 
program for making the image-processing approach and equipment list which presume 
the signal value in the total pixel location of an image pickup device perform the 
image-processing approach to a computer using the signal value acquired in an image 
pickup device like Veneer CCD and in which computer read is possible. 
[0002] 

[Description of the Prior Art] What is constituted by arranging by turns the optoelectric 
transducer which is two or more kinds from which spectral sensitivity differs as image 
pickup devices, such as CCD used for a digital camera, on the same flat surface is 
known (Veneer CCD is called below). Here, in the case of the veneer CCD which has 
arranged by turns the optoelectric transducer which has spectral sensitivity in each of R, 



G, and B, i.e., the optoelectric transducer of each channel of R, G, and B, the group of 
continuous R and G, and three optoelectric transducers of B channels will constitute one 
pixel. However, since R of each pixel, G, and B signal value cannot be acquired in the 
same pixel location in such a veneer CCD, a color gap and a false color may arise. 
Moreover, since there are few photo-electric-conversion element numbers of each 
channel than the total element number which constitutes Veneer CCD, the image of 
high resolution cannot be obtained. For example, in the veneer CCD which has 
arranged the optoelectric transducer of R, G, and B each channel by turns, since the 
photo-electric-conversion element number of each channel has only 1/3 of a total 
element number, resolution will be set to one third compared with the monochrome 
image pick-up equipment of the same element number. For this reason, although the 
method of calculating the signal value in the part which does not exist the optoelectric 
transducer of R, G, and B each channel by interpolation processing is proposed, a false 
color may occur in the part from which a signal value changes a lot only by only 
performing interpolation processing. In this case, although generating of a false color 
can be prevented by using an optical low pass filter for an image pick-up system, or 
performing data smoothing by the low pass filter to an image pick-up signal, there is a 
problem that resolution gets worse in this case. 

[0003] Here, human being's vision property has sensibility higher than a color to 
brightness. For this reason, the luminance signal showing the brightness of each pixel 
of a RF and the chrominance signal of the low frequency obtained by the interpolation 
processing mentioned above and data smoothing by the low pass filter are generated 
from the color image pick-up signal acquired in Veneer CCD, and the approach which 
reconfigurated the color picture signal using the luminance signal and the chrominance 
signal is proposed (JP, 10"200906,A etc.). According to this approach, since more 
information will be given to a brightness component with high sensibility in human 
being's vision property, the color picture signal which can reproduce an image with 
seemingly high resolution can be acquired. 

[0004] By the way, CCD which has the array structure of a honeycomb array where the 
pixel has been arranged in checkers as a veneer CCD as shown in drawing 30 is known 
(for example, JP, 10- 13639 1,A). In addition, this may be called a checkered pixel array. 
Moreover, CCD which has the array structure of a BEIYA array where the pixel has 
been arranged in the shape of a square as shown in drawing 31 is also known. In 
addition, this may be called a square -like pixel array. Also in the veneer CCD which has 
such array structure, i.e., a pixel array, the problem of a false color arises like the above. 
For this reason, in order to remove a false color about the signal of the quantity of light 



base obtained in CCD of the BEIYA array mentioned above In a perpendicular direction 
or horizontal Rhine [ in / based on assumption that the ratio of the signal of r, g, and b is 
abbreviation regularity in the local field in an image / CCD of a BEIYA array ] By 
carrying out the multiplication of the ratio of r signal and g" signal in adjoining Rhine to 
g signal, the approach which computed r signal in the Rhine is learned (JP,9"214989,A). 
In the pixel array shown in drawing 32 , in order to search for the r signal rl2 in g 
12-pixel location, this approach specifically gll signal in r 11-pixel location is first 
computed by the operation of (g6+gl6) / 2, and rl2 signal is computed by the operation 
of rl2=gl2xrll/gll based on an assumption called rll:gll=rl2:gl2. 

[0005] However, in the approach indicated by above-mentioned JP,10"200906,A etc., no 
matter it may perform data smoothing with what low pass filter to the image pick-up 
signal acquired in Veneer CCD, since the high frequency component in an actual image 
will already be turned up in an image, moire by clinch strain cannot be removed and, as 
a result, a false color cannot fully be removed. 

[0006] On the other hand, according to the approach indicated by above-mentioned 
JP,9-214989,A, a false color is effectively removable. Especially this approach is based 
on the assumption that the ratio of the quantity of light of r^g:b is fixed, in the local field 
of an image, and when the ratio of the obtained RGB code is an analog signal 
proportional to the quantity of light, the false color in the picture signal acquired in 
CCD of a BEIYA array can be removed efficiently. However, since the signal value is 
expressed that it becomes an index number to the quantity of light, and an opposite 
numeric value like R=r 0.45 and R=log (r) when performing A/D conversion and 
changing the quantity of light rgb into a digital RGB code in order that the picture 
signal acquired with a digital camera may reduce a quantization error, and in order to 
input a signal into the video circuit of a computer system for example, r*g^b=R"G-B does 
not become. For this reason, although the approach indicated by above-mentioned 
JP,9~214989,A can remove a false color to the analog signal with which a signal value is 
proportional to the quantity of light, when the signal value is expressed by the index 
number and opposite numeric value of the quantity of light, it cannot remove a false 
color. Moreover, a false color is generated also not only in the veneer CCD of a BEIYA 
array but in the veneer CCD of a honeycomb array. 

[0007] For this reason, when the signal value acquired in the image pickup device is 
expressed by the index number to the quantity of light, and the opposite numeric value, 
based on the premise that the difference of RGB each signal value is fixed in the local 
field of an image, the approach of computing the signal value in each pixel location is 
proposed in consideration of the direction where the signal value in the pixel location 



which computes a signal value changes (Japanese Patent Application No. No. 212202 
[ 11 to ]). Hereafter, this approach is explained concretely. 

[0008] First, it considers as the honeycomb array which shows the pixel array of CCD 
which is an image pickup device to drawing 30 , and a reference number is given to each 
pixel location as shown in drawing 33 . In addition, when it is considered that this pixel 
array is a square array, the pixel location which does not have a signal value is shown 
using * in drawing 33 . Moreover, the signal value acquired in each channel makes the 
direction which extends the direction which shall be 8 bits and extends at the lower 
right from the space upper left at the lower left from the direction of arrowhead A, and 
the space upper right the direction of arrow-head B, and presupposes below that the 
direction of arrow-head A and the direction of arrowhead B are eternal into this 
specification. In addition, here explains calculation of R signal (it is written as R (B24) 
signal below) in B 24-pixel location. First, R(B24) A signal of B 24-pixel location is 
searched for by the following formula (l) about the direction of arrowhead A. 
[0009] 

R(B24)A=G(B24)A+((R(G33)A-G33)+(R(G15)A-Gl5))/2 (l) 

However, G(B24) A signal is a G signal of B 24-pixel location which performed and asked 
for 1-dimensional interpolation operations, such as a 1-dimensional Cubic spline 
interpolation operation, in the direction of arrowhead A from G signal in the G pixel 
location on Rhine where a pixel is located in a line with B02, G13, B24, and G35 --. 
Moreover, a pixel R(G33) A signal - It is R signal of G 33-pixel location which performed 
and asked for the 1-dimensional interpolation operation in the direction of arrow-head A 
from R signal in the R pixel location on Rhine on a par with R22, G33, R44, and G55 --. 
Furthermore, R(G15) A signal is an R signal of G 15-pixel location which performed and 
asked for the 1-dimensional interpolation operation in the direction of arrowhead A 
from R signal in the R pixel location on Rhine where a pixel is located in a line with R04, 
G15, R26, and G37 --. 

[0010] Next, R(B24) B signal of B 24-pixel location is searched for by the following 

formula (2) about the direction of arrowhead B. 

[0011] 

R(B24)B=G(B24)B+((R(Gl3)B-G13)+(R(G35)B-G35))/2 (2) 

However, G(B24) B signal is a G signal of B 24-pixel location which performed and 
asked for the 1-dimensional interpolation operation in the direction of arrowhead B 
from G signal in the G pixel location on Rhine where a pixel is located in a line with B06, 
G15, B24, and G33 --. Moreover, R(G13) B signal is an R signal of G 13-pixel location 
which performed and asked for the 1-dimensional interpolation operation in the 



direction of arrow-head B from R signal in the R pixel location on Rhine where a pixel is 
located in a line with R04, G13, R22, and G31 --. Furthermore, a pixel R(G35) B signal - 
It is R signal of G 35-pixel location which performed and asked for the 1-dimensional 
interpolation operation in the direction of arrowhead B from R signal in the R pixel 
location on Rhine on a par with R26, G35, R44, and G53 ■-. 

[0012] And the variations SA and SB showing the amount of fluctuation of the signal 
value about the direction of arrow-head A in B 24-pixel location and the direction of 
arrow-head B are computed by the following formula (3) and (4), and the weighting 
multiplier Sj for carrying out weighting addition of R(B24) A signal and the R(B24) B 
signal by the formula (5) using Variations SA and SB is computed further. 
[0013] 

SA= I B24-G(B24)A | /(B24+G(B24)A) (3) 
SB= | B24-G(B24)B I /(B24+G(B24)B) (4) 
Sj=SA/(SA+SB) (SA+SB= if it is 0 Sj= 0.5) (5) 

Thus, if the weighting multiplier Sj is called for, R (B24) signal will be computed by the 

following formula (6). 

[0014] 

R(B24)=(l-Sj)*R(B24)A+Sj*R(B24)B (6) 

According to this approach, even if it is the case where the signal value acquired in the 
image pickup device is expressed by the index number and the opposite numeric value, 
the signal value in a total pixel location can be calculated, without generating a false 
color. Moreover, in this approach, while being able to prevent generating of a false color 
irrespective of the direction of a signal value change by computing the signal value in 
each pixel location by carrying out weighting addition of the signal value computed 
about the rectangular direction which intersects perpendicularly with the 
predetermined direction on an image pickup device, and this according to the direction 
where a signal value changes as shown in the above-mentioned formula (6), generating 
of the artifact can also be prevented. 
[0015] 

[Problem(s) to be Solved by the Invention] By the approach of above-mentioned 
Japanese Patent Application No. No. 212202 [ 11 to ], the weighting multiplier is 
computed in the above-mentioned formula (5) by doing the division by the aggregate 
value (SA+SB) of Variation SA and Variation SB to Variation SA. Here, in the 
arithmetic circuit which performs various operations, when operations are only addition, 
subtraction, and multiplication, comparatively few arithmetic elements can constitute a 
circuit. However, while many arithmetic elements will be needed and the configuration 



of a circuit will be complicated since an operation becomes complicated if a division is 
included like the above-mentioned formula (5), an operation takes long duration. 
[0016] This invention is made in view of the above-mentioned situation, and it aims at 
offering the record medium which recorded the program for making the 
image-processing approach and equipment list which can ask for a weighting multiplier 
by simple circuitry perform the image -processing approach to a computer and in which 
computer read is possible. 
[0017] 

[Means for Solving the Problem] The image-processing approach by this invention is the 
image pickup device with which the 1st to 3rd [ which has different spectral sensitivity ] 
optoelectric transducer has been arranged on a single side, and the image pick-up side 
was formed. Arrange said the 1st and said 2nd optoelectric transducer by turns in the 
predetermined direction, and the 1st line is formed. Arrange said the 1st and said 3rd 
optoelectric transducer by turns in said predetermined direction, and the 2nd line is 
formed, the rectangular direction which intersects perpendicularly with said 
predetermined direction - setting - said the 1st and said 2nd optoelectric transducer - 
alternation - and so that said the 1st and said 3rd optoelectric transducer may be 
arranged by turns By arranging the 1st and said said 2nd line by turns in said 
rectangular direction It is based on the 1st to 3rd [ which was obtained in the image 
pickup device with which said image pick-up side which consists of the 1st to 3rd pixel 
was formed ] signal value. In the image-processing approach of presuming at least one 
signal value among the said 1st [ the ] in total pixel location to 3rd signal values The 
rectangular direction estimate which is the estimate of the predetermined direction 
estimate which is the estimate of the signal value about said predetermined direction, 
and the signal value about said rectangular direction is computed. The rectangular 
direction variation showing the amount of fluctuation of the predetermined direction 
variation showing the amount of fluctuation of the signal value about said 
predetermined direction and the signal value about said rectangular direction is 
computed. The ratio of said predetermined direction variation to the aggregate value of 
said predetermined direction variation and said rectangular direction variation, or said 
rectangular direction variation Said predetermined direction estimate and said 
rectangular direction estimate are faced computing as a weighting multiplier at the 
time of carrying out weighting addition. It is based on the relation between said 
predetermined direction variation at the time of presupposing that said weighting 
multiplier is fixed, and said rectangular direction variation. The storage means which 
computed beforehand the correspondence relation between the predetermined direction 



variation to two or more weighting multipliers and the rectangular direction variation, 
and memorized it is referred to. Based on the weighting multiplier of 1, weighting 
addition of said predetermined direction estimate and said rectangular direction 
estimate is carried out. said predetermined direction variation and said rectangular 
direction variation - being based - the weighting multiplier of said two or more 
weighting multipliers to 1 - choosing - this - It is characterized by presuming at least 
one signal value among said the 1st to 3rd signal values. 

[0018] In the veneer CCD of a honeycomb array as shown in drawing 30 , supposing it 
makes the 3rd signal value correspond to G, R, and B from the 1st to 3rd pixel, and the 
1st signal value, respectively, here Becoming GR Rhine which has arranged GR pixel by 
turns in the direction of the lower right (this is made into the predetermined direction) 
from the drawing 30 top upper left, the 2nd line of the 1st line turns into GB Rhine 
which has arranged GB pixel by turns in the same direction as the 1st line. Moreover, 
GR Rhine and GB Rhine are arranged by turns also in the predetermined direction and 
the direction which intersects perpendicularly, an index number [ as opposed to the 
quantity of light in the signal value acquired in an image pickup device / like Veneer 
CCD / whose image-processing approach by this invention is ], and a logarithm - a field 
local [ on an image ] when expressed by the value - setting - the difference of each 
signal value - based on the premise that a value becomes equal, all the signal values in 
each pixel location are presumed from the 1st to 3rd [ which was obtained in such an 
image pickup device ] signal value. In addition, in this invention, the pixel array of an 
image pickup device is not limited to this. 

[0019] The "predetermined direction estimate" and the "rectangular direction estimate" 
are at least one signal value among the 1st to 3rd [ which was presumed about the 
predetermined direction and the rectangular direction, respectively ] signal values. 
[0020] It says calculating Variation SA and Variation SB as the predetermined direction 
variation and a rectangular direction variation by the operation approach shown in for 
example, the above-mentioned type (3) "which computes the predetermined direction 
variation and the rectangular direction variation", and (4). Moreover, Variation SA and 
Variation SB may be calculated as the predetermined direction variation and a 
rectangular direction variation by the operation approach shown in the following 
formula (7) and (8). 
[0021] 

SA=|B24-G(B24)A| (7) 
SB=|B24-G(B24)B| (8) 

In addition, in the image-processing approach by this invention, it is desirable for it to 



means to compute the rectangular direction variation showing the amount of 
fluctuation of the predetermined direction variation showing the amount of fluctuation 
of the signal value about said predetermined direction, and the signal value about said 
rectangular direction, The ratio of said predetermined "direction variation to the 
aggregate value of said predetermined direction variation and said rectangular 
direction variation, or said rectangular direction variation Said predetermined direction 
estimate and said rectangular direction estimate are faced computing as a weighting 
multiplier at the time of carrying out weighting addition. Based on the relation between 
said predetermined direction variation at the time of presupposing that said weighting 
multiplier is fixed, and said rectangular direction variation, the correspondence relation 
between the predetermined direction variation to two or more weighting multipliers 
and the rectangular direction variation is computed beforehand. The storage means 
which memorized this relation, and a weighting multiplier selection means to choose 
the weighting multiplier of 1 from said two or more weighting multipliers with 
reference to said storage means based on said predetermined direction variation and 
said rectangular direction variation, this - based on the weighting multiplier of 1, 
weighting addition of said predetermined direction estimate and said rectangular 
direction estimate is carried out, and it is characterized by having a weighting addition 
means to presume at least one signal value among said the 1st to 3rd signal values. 
[0025] In addition, in the image processing system by this invention, it is set up and 
becomes so that the ratio of said predetermined direction variation [ as opposed to said 
aggregate value in said two or more weighting multipliers in said correspondence 
relation memorized by said storage means ] or said rectangular direction variation may 
be set to l/2n (n is the natural number), and as for said weighting addition means, it is 
desirable that it is a means by which the bit shift based on said weighting multiplier of 
selected 1 performs said weighting addition. 

[0026] Furthermore, in the image processing system by this invention, it is desirable 
that said said the 1st to 3rd optoelectric transducer is what has spectral sensitivity in 
one color of G, B, and R or one color of Y, G, and C, respectively. 

[0027] In addition, the image-processing approach by this invention may be recorded on 
the record medium in which computer read is possible as a program for performing a 
computer, and may be offered. 

[0028] Moreover, image readers, such as image pick-up equipments, such as a digital 
camera, or a scanner, may be carried and provided with the image processing system by 
this invention. 
[0029] 



[Effect of the Invention] According to this invention, it faces computing the ratio of the 
predetermined direction variation to the aggregate value of the predetermined direction 
variation and the rectangular direction variation, or the rectangular direction variation 
as a weighting multiplier, the correspondence relation Between the predetermined 
direction variation to two or more weighting multipliers and the rectangular direction 
variation is beforehand computed based on the relation between the predetermined 
direction variation at the time of presupposing that a weighting multiplier is fixed, and 
the rectangular direction variation, and this is memorized for the storage means. And in 
the pixel location which presumes a signal value, the predetermined direction variation 
and the rectangular direction variation are computed, the weighting multiplier of 1 is 
chosen with reference to the above-mentioned storage means, and it is made to perform 
weighting addition with the predetermined direction estimate and the rectangular 
direction estimate based on this weighting multiplier of 1. 

[0030] When computing a weighting multiplier by the above-mentioned formula (5) and 
this is solved about the amount SB of fluctuation here, it is SB=(l-Sj) (/Sj) *SA. (9) 
It becomes. It is shown that the relation between Variation SA and Variation SB is that 
this has the fixed weighting multiplier Sj in proportionality. Therefore, correspond 
Variation SA with the predetermined direction variation, and Variation SB is made to 
correspond with the rectangular direction variation, and when the two-dimensional flat 
surface which makes a x axis the predetermined direction variation and makes the 
y-axis the rectangular direction variation is set up, in this two-dimensional flat-surface 
top, two or more weighting multipliers are expressed as a straight line passing through 
the zero which has an inclination according to that weighting multiplier (a zero is not 
included strictly). 

[0031] In this invention, by two or more straight lines which have an inclination 
according to a weighting multiplier, for example Divide a two-dimensional flat surface 
into two or more fields, ask for this as correspondence relation between the 
predetermined direction variation to two or more weighting multipliers, and the 
rectangular direction variation, and this is memorized for the storage means. The 
weighting multiplier corresponding to the field which judged whether the 
predetermined direction variation and the rectangular direction variation which were 
computed would be contained to which field on the above-mentioned two-dimensional 
flat surface, and was judged that these are located can be chosen as a weighting 
multiplier of 1. 

[0032] Therefore, according to this invention, in order to ask for a weighting multiplier, 
as shown in a formula (5), it becomes unnecessary to do the division of the 



predetermined direction variation or the rectangular direction variation with the 
aggregate value of the predetermined direction variation and the rectangular direction 
variation, and thereby, the amount of operations can be reduced and the configuration of 
the circuit for calculating can also be made simple. Therefore, it becomes easy to carry 
the equipment for carrying out this invention in small image pick-up equipments, such 
as a digital camera, and image readers, such as a scanner. 

[0033] Moreover, when being set up so that the value of the predetermined direction 
variation [ as opposed to an aggregate value in a weighting multiplier ] or the 
rectangular direction variation may be set to l/2n (n is the natural number) and the 
predetermined direction estimate and the rectangular direction estimate are expressed 
with a binary number, carrying out the multiplication of 1/the 2n to these will perform 
the operation equivalent to making right-hand side carry out a value n bit shift. 
Therefore, by performing weighting addition of the predetermined direction estimate 
and the rectangular direction estimate by the bit shift, it is calculating simply and the 
processing time can be shortened. 
[0034] 

[Embodiment of the Invention] With reference to a drawing, the operation gestalt of this 
invention is explained below. Drawing 1 is the outline block diagram showing the 
configuration of the image processing system by the 1st operation gestalt of this 
invention. As shown in drawing 1 , the image processing system by the 1st operation 
gestalt of this invention performs interpolation processing to the signal value acquired 
in each optoelectric transducer which constitutes the veneer CCD 1, the signal value in 
a total pixel location is calculated, and interpolation processing is performed to the 
image data SO constituted by each signal value, and it has a interpolation means 2 
obtain the interpolated image data SI. The interpolation means 2 is equipped with a 
check square interpolation means 5 to compute the signal value of hole pixel location * 
indicated to be a G interpolation means 3 to compute the G signal QG by the 
interpolation operation as mentions later, and a RB interpolation means 4 to compute 
the R signal QR and the B signal QB to drawing 3 later mentioned from the G signal QG, 
the R signal QR, and the B signal QB. In addition, in the veneer CCD 1 shown in 
drawing 1 , although an analog signal is acquired from the optoelectric transducer 
which constitutes this, the image data SO in this operation gestalt shall be the digital 
signal which carried out A/D conversion of the analog signal, and the digital signal of a 
parenthesis shall be changed so that it may become the 0.45th power or opposite 
numeric value of the quantity of light inputted into the veneer CCD 1. 
[0035] In addition, the image processing system by this operation gestalt may be 



the direction where a pixel is located in a line with R00, Gil, R22, G33, and R44 - in 
drawing 4 , (the direction of arrowhead A) is made into the predetermined direction, 
and the direction which intersects perpendicularly in this predetermined direction of 
arrow-head A, i.e., the direction, is made into the direction of arrowhead B. In addition, 
with this operation gestalt, the reference number given to the pixel location is used also 
as a reference number of a signal value. 

[0039] Drawing 5 is the outline block diagram showing the configuration of RB 
interpolation means 4. A 1st interpolation means 11 by which RB interpolation means 4 
computes R signal and B signal (it names generically and considers as a signal Ql) in a 
total pixel location about the direction of arrow-head A in drawing 4 as shown in 
drawing 5 , A 2nd interpolation means 12 to compute R signal and B signal (for it to 
name generically and to consider as a signal Q2) in a total pixel location about the 
direction of arrowhead B, A variation calculation means 13 to compute the value 
showing the amount of fluctuation of the signal value in the direction of arrowhead A, 
and the direction of arrowhead B as variations SA and SB, Memory 14A which 
memorized the correspondence relation of the variations SA and SB to the weighting 
multiplier Sj at the time of carrying out weighting interpolation of the signals Ql and 
Q2 acquired in the 1st interpolation means 11 and the 2nd interpolation means 12 
about two or more weighting multipliers, A weighting multiplier selection means 14 to 
choose the weighting multiplier Sj of 1 from two or more weighting multipliers with 
reference to the correspondence relation memorized by memory 14A based on the 
variations SA and SB computed in the variation calculation means 13, It has a 
weighting addition means 15 to carry out weighting addition of the signals Ql and Q2 
acquired in the 1st interpolation means 11 and the 2nd interpolation means, and to 
acquire the R signal QR and the B signal QB with the weighting multiplier Sj chosen in 
the weighting multiplier selection means 14. 

[0040] Subsequently, calculation of the G signal QG in G interpolation means 3 of this 
operation gestalt and the R signal QR in RB interpolation means 4, and the B signal QB 
is explained. 

[0041] (l) Explain calculation processing of G signal in R and a B pixel location first. 
Calculation of this G signal is performed in G interpolation means 3. G signal in R and a 
B pixel location is computable by performing a spline interpolation operation to G signal 
acquired in the G pixel location around the pixel location. Drawing 6 is drawing 
showing the example of the two-dimensional Cubic spline interpolation filter which 
performs a spline interpolation operation. The two-dimensional Cubic spline 
interpolation filter shown in drawing 6 performs a interpolation operation to G signal in 



the G pixel location 16 pixels near the pixel location which computes G signal. Therefore, 
G (R44) signal in R 44-pixel location surrounded as the continuous line in drawing 7 As 
opposed to G signal of the G pixel location of 16 of the perimeter enclosed with a broken 
line (Gil, G13, G15, G17, G31, G33, G35, G37, G51, G53, G55, G57, G71, G73, G75, 
Group 77) It is computed by performing filtering processing with the two-dimensional 
Cubic spline interpolation filter shown in drawing 6 . On the other hand, G (B46) signal 
in B 46-pixel location is computed by performing filtering processing similarly to G 
signal of the G pixel location (G13, G15, G17, G19, G33, G35, G37, G39, G53, G55, G57, 
G59, G73, G75, Group 77, G79) of the perimeter enclosed with a broken line. G signal 
which could interpolate, without this spoiling the frequency component which G signal 
has before interpolation, consequently held the frequency information on original in all 
pixel locations can be acquired. 

[0042] Here, any technique is applicable if it is a interpolation operation in the 
in-every-direction two-dimensional direction in drawing 4 as the technique of a 
interpolation operation. In addition, G signal in R and a G pixel location may be 
computed by performing a simple linear interpolation operation to G signal acquired in 
the G pixel location around a pixel location which computes G signal. For example, G 
(R44) signal in R 44-pixel location surrounded as the continuous line in drawing 7 and G 
(B46) signal in B 46-pixel location may be computed by the following formula (10) and 
(11) using G signal in four G pixel locations of the perimeter. 
[0043] 

G(R44)=(G33+G35+G53+G55)/4 (10) 
G(B46)=(G35+G37+G55+G57)/4 (11) 

(2) Next, explain calculation of the R signal QR in RB interpolation means 4, and the B 
signal QB. First, calculation of the signals Ql and Q2 in the 1st and 2nd interpolation 
means 11 and 12 is explained. 

[0044] 1 -- calculation processing of R signal about the direction of arrowhead A in the 
G pixel location in Rhine (it considers as the 1st Rhine below) located in a line in R and 
G pixels in the direction of arrow-head A is explained first. Calculation of the signal 
about this direction of arrow-head A is performed in the 1st interpolation means 11. in 
addition, ** which gives (A) to the signal computed about the direction of arrow-head A 
in subsequent explanation at a reference mark, and gives (B) to the signal computed 
about the direction of arrow-head B at a reference mark - ** - it carries out. Moreover, 
Rhine where B and G pixels are located in a line in the 3rd Rhine and the direction of 
arrow-head B in Rhine where R and G pixels are located in a line in the 2nd Rhine and 
the direction of arrowhead B in Rhine where B and G pixels are located in a line in the 



1st Rhine and the direction of arrowhead A in Rhine where R and G pixels are located 
in a line in the direction of arrowhead A is made into the 4th Rhine. 
[0045] Calculation processing of R signal in the G pixel location about the direction of 
arrowhead A in the 1st Rhine is performed by performing a 1 -dimensional interpolation 
operation to R signal on the 1st Rhine in which the G pixel location is included. For 
example, R(G33) A signal in G 33'pixel location enclosed with the continuous line in 
drawing 8 It is computed by performing 1-dimensional interpolation operations, such as 
a 1-dimensional Cubic spline interpolation operation shown in the following formula 
(12), to R signal acquired in R pixels of four points around G 33-pixel location on the 1st 
Rhine in which G 33-pixel location exists (R00, R22, R44, R66). 
[0046] 

R(G33)A=(-3*ROO+19*R22+19*R44-3*R66)/32 (12) 

In addition, you may compute by the following formula (13) using R22 in two R pixel 
locations which adjoin in the direction of arrow-head A in the 1st Rhine, and R44 signal. 
[0047] 

R(G33)A=(R22+R44)/2 (13) 

Moreover, any technique is applicable if it is a 1-dimensional interpolation operation in 
the direction of arrowhead A on this 1st Rhine as the technique of a interpolation 
operation. And thereby, R signal in the G pixel location on the 1st Rhine is computable. 
[0048] Calculation processing of R signal about the direction of arrowhead B in the G 
pixel location in 2, next the 1st Rhine where R and G pixels are located in a line in the 
direction of arrowhead A is explained. Calculation of the signal about this direction of 
arrow-head B is performed by [ as being the following in the 2nd interpolation means 
12 ]. First, it asks for the pixel location which adjoins the G pixel location which 
computes R signal in the direction of arrow-head A. For example, if R(G33) B signal in G 
33 -pixel location enclosed with the continuous line shown in drawing 9 here shall be 
computed, the pixel location contiguous to G 33-pixel location will turn into R 22-pixel 
location and R 44-pixel location enclosed with a broken line. And the average of the 
difference of R22 signal and G (R22) signal in this R 22-pixel location and the difference 
of R44 signal and G (R44) signal in R 44-pixel location is added to G33 signal in G 
33-pixel location, and that addition result is made into R(G33) B signal in G 33-pixel 
location. 

. [0049] Here, when only R22 signal is used, R(G33) B signal in G 33-pixel location is 
computed by the following formula (14). 
[0050] 

R(G33)B=G33+(R22-G(R22)) (14) 



In addition, it is set by the premise that the formula (14) of the difference of R signal 
and G signal in the local field of an image is equal. For example, it is R(G33) 
B-G33=R22-G (R22) that the difference of R signal in R 22-pixel location and G 33-pixel 
location and G signal is equal. (15) 

I hear that ****** is filled, it is and what solved the formula (15) about R(G33) B signal 
serves as a formula (14). In addition, in a formula (14), G (R22) signal was not computed 
by the approach of the above (l), and is computed to G signal on the 3rd Rhine in which 
R 22-pixel location exists by performing 1-dimensional interpolation operations, such as 
a 1-dimensional Cubic spline interpolation operation shown in the linear interpolation 
operation shown in the following formula (16) in the direction of arrowhead B, or a 
formula (12). Therefore, a reference mark B will be given to G (R22) signal. 
[0051] G(R22)B=(G31+Gl3)/2 (16) 

That is, by the formula (14), the signal value is computed by the premise that the 
difference of R signal and G signal in the local field of an image is equal, and the 4th 
Rhine where G 33-pixel location exists in the direction of arrow-head B, and the 3rd 
Rhine where R 22-pixel location exists use it for calculation of a signal value. It needs to 
compute a signal value by this meaning that the signal value is computed based on the 
correlation of the pixel value on the 3rd and 4th Rhine, there being, and making the 
signal value change in the direction of arrowhead B reflect about an unknown signal 
value. In processing of 2, when only R22 signal is used, R(G33) B signal in G 33-pixel 
location is computed based on the relation shown in the above-mentioned formula (15), 
but since G (R22) signal is unknown, it is necessary to presume this. A formula (15) 
needs to make the signal value change of the direction of arrow-head B reflect on the 
3rd Rhine here, in order to presume G (R22) signal, since the correlation between the 
3rd and 4th Rhine is expressed. In this case, although it is possible to use G signal 
computed by the approach of the above (l), since this G signal is what is being computed 
using the signal value of another Rhine as shown in a formula (10) and (ll), it is not a 
thing reflecting the signal value change of the direction of arrowhead B on the 3rd 
Rhine. For this reason, in order to make the signal value change of the direction of 
arrowhead B reflect, G(R22) B signal is computed by performing the 1-dimensional 
interpolation operation about the direction of arrowhead B on the 3rd Rhine like a 
formula (16). 

[0052] On the other hand, if only R44 signal is used, based on the relation of the 
above-mentioned formula (15), R(G44) B signal in G 33-pixel location will be computed 
by the following formula (17). 
[0053] 



R(G33)B=G33+(R44-G(R44)B) (17) 

In addition, G(R44) B signal is computed like a formula (16). Here, in this operation 
gestalt, although R(G33) B signal may be searched for by the formula (14) or either of 
(17), by having used the signal value of the pixel location which adjoins only one side of 
a G pixel location, the phase of an image will approach in the direction. In order to 
prevent this, as shown in the following formula (18), what added the average of the 
difference of R signal and G signal in the pixel location (R22, R 44 pixel location) of the 
neighbors of the G pixel location (for example, G 33 pixel location) which computes R 
signal to G signal in the G pixel location which computes R signal is made into R signal 
in the G pixel location. 
[0054] 

R(G33)B=G33+((R22-G(R22)B)+(R44-G(R44)B))/2 (18) 

And thereby, R(G33) B signal in the G pixel location about the direction of arrowhead B 
is computable. 

[0055] Calculation processing of R signal about the direction of arrow-head A in the G 
pixel location in 3, next the 2nd Rhine where B and G pixels are located in a line in the 
direction of arrowhead A is explained. Calculation of the signal about this direction of 
arrowhead A is performed in the 1st interpolation means 11. First, it asks for the pixel 
location which adjoins the G pixel location which computes R signal in the direction of 
arrowhead B. For example, if R(G35) A signal in G 35-pixel location enclosed with the 
continuous line shown in drawing 10 here shall be computed, the pixel location 
contiguous to G 35-pixel location will turn into R 26-pixel location and R 44-pixel 
location enclosed with a broken line. And like processing of the above 2, as shown in the 
following formula (19), the average of the difference of R26 signal and G(R26) A signal 
in R 26-pixel location and the difference of R44 signal and G(R44) A signal in R 44-pixel 
location is added to G35 signal in G 35-pixel location, and the addition result is made 
into R(G35) A signal in G 35 pixel location. 
[0056] 

R(G35)A=G35+((R26-G(R26)A)+(R44-G(R44)A))/2 (19) 

In addition, G(R26) A signal and G(R44) A signal are computed to G signal on the 1st 
Rhine in which R26 and R 44-pixel location exist by performing a 1-dimensional 
interpolation operation in the direction of arrowhead A. And thereby, R(G35) A signal 
in the G pixel location about the direction of arrow-head A is computable. 
[0057] Calculation processing of R signal about the direction of arrow-head B in the G 
pixel location in 4, next the 2nd Rhine where B and G pixels are located in a line in the 
direction of arrowhead A is explained. Calculation of the signal about this direction of 



arrowhead B is performed by performing a l dimensional interpolation operation in the 
2nd interpolation means 12 to R signal on the 3rd Rhine in which that G pixel location 
is included. For example, R(G35) B signal in G 35-pixel location enclosed with the 
continuous line in drawing 11 is computed to R signal acquired in R pixels of four points 
around G 35-pixel location on the 3rd Rhine in which G 35-pixel location exists (R08, 
R26, R44, R62) by performing a 1 -dimensional interpolation operation as well as 
processing of 1. The example of calculation by the 1-dimensional Cubic spline 
interpolation operation is shown in the following formula (20). 
[0058] 

R(G35)B=(-3*R08+19*R26+19*R44-3*R62)/32 (20) 

Calculation processing of R signal about the direction of arrow-head A in the B pixel 
location in 5, next the 2nd Rhine where B and G pixels are located in a line in the 
direction of arrow-head A is explained. Calculation of the signal about this direction of 
arrow-head A is performed in the 1st interpolation means 11. First, it asks for the pixel 
location which adjoins the B pixel location which computes R signal in the direction of 
arrow-head B. For example, if R(B24) A signal in B 24-pixel location enclosed with the 
continuous line shown in drawing 12 here shall be computed, the pixel location 
contiguous to B 24-pixel location will turn into G 15-pixel location and G 33-pixel 
location enclosed with a broken line. Like processing of the above 2, as shown in the 
following formula (21), and the average of the difference of the R(G15) A signal and G15 
signal in G 15-pixel location, and the difference of the R(G33) A signal and G33 signal in 
G 33-pixel location It adds to G(B24) A signal in B 24-pixel location, and the addition 
result is made into R(B24) A signal in B 24-pixel location. 
[0059] 

R(B24)A=G(B24)A+((R(G33)A-G33)+(R(G15)A-G15))/2 (21) 

In addition, R(G15) A signal and R(G33) A signal are the R signals itself which 
computed to R signal on the 1st Rhine in which G15 and G 33-pixel location exist by 
performing a 1-dimensional interpolation operation in the direction of arrowhead A, 
and was computed in processing of 1. Moreover, G(B24) A signal is computed by 
performing a 1-dimensional interpolation operation in the direction of arrowhead A to 
G signal on the 2nd Rhine in which B 24-pixel location exists. And thereby, R(B24) A 
signal in the B pixel location about the direction of arrowhead A is computable. 
[0060] Calculation processing of R signal about the direction of arrowhead B in the B 
pixel location in 6, next the 2nd Rhine where B and G pixels are located in a line in the 
direction of arrow-head A is explained. Calculation of the signal about this direction of 
arrow-head B is performed in the 2nd interpolation means 12. First, it asks for the pixel 



location which adjoins the B pixel location which computes R signal in the direction of 
arrow-head A. For example, if R(B24) B signal in B 24-pixel location enclosed with the 
continuous line shown in drawing 13 here shall be computed, the pixel location 
contiguous to B 24-pixel location will turn into G 13-pixel location and G 35-pixel 
location enclosed with a broken line. Like processing of the above 2, as shown in the 
following formula (22), and the average of the difference of the R(G13) B signal and G13 
signal in G 13-pixel location, and the difference of the R(G35) B signal and G35 signal in 
G 35-pixel location It adds to G(B24) B signal in B 24-pixel location, and the addition 
result is made into R(B24) B signal in B 24-pixel location. 
[0061] 

R(B24)B=G(B24)B+((R(G35)B-G35)+(R(G13)B-Gl3))/2 (22) 

In addition, R(G13) B signal and R(G35) B signal are the R signals itself which 
computed to R signal on the 3rd Rhine in which G13 and G 35-pixel location exist by 
performing a 1-dimensional interpolation operation in the direction of arrow-head B, 
and was computed in processing of 4. Moreover, G(B24) B signal is computed to G signal 
on the 4th Rhine in which B 24-pixel location exists by performing a 1-dimensional 
interpolation operation in the direction of arrow-head B. And thereby, R(B24) B signal 
in the B pixel location about the direction of arrowhead B is computable. 
[0062] As mentioned above, R signal about the direction of arrow-head A in the G pixel 
location in the 1st Rhine where R and G pixels are located in a line in the direction of 
arrow-head A by processing of 1 is computed, and R signal about the direction of 
arrow head B in the G pixel location in the 1st Rhine where R and G pixels are located 
in a line in the direction of arrowhead A by processing of 2 is computed. 
[0063] Moreover, R signal about the direction of arrowhead A in the G pixel location in 
the 2nd Rhine where B and G pixels are located in a line in the direction of arrow-head 
A by processing of 3 is computed, and R signal about the direction of arrowhead B in 
the G pixel location in the 2nd Rhine where B and G pixels are located in a line in the 
direction of arrowhead A by processing of 4 is computed. 

[0064] Furthermore, R signal about the direction of arrowhead A in the B pixel location 
in the 2nd Rhine where B and G pixels are located in a line in the direction of 
arrow-head A by processing of 5 is computed, and R signal about the direction of 
arrow-head B in the B pixel location in the 2nd Rhine where B and G pixels are located 
in a line in the direction of arrowhead A by processing of 6 is computed. 
[0065] As mentioned above, although calculation of the arrow head A in each pixel 
location and R signal in B both directions was explained, as B signal was also explained 
in processing of the above 1*6, it is computable like R signal. 



[0066] The variation calculation means 13 computes the variations SA and SB required 
for calculation of the weighting multiplier for carrying out weighting addition of the 
signal value of the arrow head A computed by processing of 1, 2, 3 and 4, and 5 and 6, 
and the direction of B in a weighting multiplier selection means 14 to mention later. 
Here, in the pixel location which presumes a signal value, the thing showing the 
amount of fluctuation of a signal value of a value is said in Variations SA and SB. 
[0067] First, calculation of the variations SA and SB for computing the weighting 
multiplier of the arrow head A computed by processing of 1 and 2 and R signal of the 
direction of B is explained. The variation SA about this direction of arrowhead A and 
the variation SB about the direction of arrowhead B are computed by the following 
formula (23) and (24). In addition, the variations SA and SB of the signal value in G 
33-pixel location shown in drawing 8 shall be computed like processing of 1 and 2 here. 
[0068] 

SA=|R(G33)A-G33| (23) 
SB=|B(G33)B-G33| (24) 

The signal value with which R(G33) A in a formula (23) was computed by the formula 
(12) in processing of 1 here, B(G33) B in a formula (24) is the signal value computed by 
performing a 1-dimensional interpolation operation to B signal acquired in the B pixel 
location of four points around G 33-pixel location on the 4th Rhine (B06, B24, B42, B60). 
Thus, the computed variation SA expresses the signal value change in the direction of 
arrowhead A of G 33-pixel location, and Variation SB expresses the signal value change 
in the direction of arrow-head B of G 33-pixel location. 

[0069] Next, calculation of the variation for computing the weighting multiplier of the 
arrow head A computed by processing of 3 and 4 and R signal of the direction of B is 
explained. The variation SA about this direction of arrow-head A and the variation SB 
about the direction of arrowhead B are computed by the following formula (25) and (26). 
In addition, the variation of the signal value in G 35-pixel location shown in drawing 10 
shall be computed like processing of 3 and 4 here. 
[0070] 

SA=|B(G35)A-G35| (25) 
SB=|R(G35)B-G35| (26) 

As opposed to B signal with which B(G35) A in a formula (25) is obtained here in the B 
pixel location of four points around G 35-pixel location on the 2nd Rhine (B02, B24, B46, 
B68) R(G35) B in the signal value and formula (26) which were computed by performing 
a 1-dimensional interpolation operation is the signal value computed by the formula 
(20) in processing of the above 4. Thus, the computed variation SA expresses the signal 



value change in the direction of arrowhead A of G 35-pixel location, and Variation SB 
expresses the signal value change in the direction of arrowhead B of G 35-pixel location. 
[0071] Next, calculation of the variation for computing the weighting multiplier of the 
arrow head A computed by processing of 5 and 6 and R signal of the direction of B is 
explained. The variation SA about this direction of arrowhead A and the variation SB 
about the direction of arrow-head B are computed by the following formula (27) and (28). 
In addition, the variation of the signal value in B 24-pixel location shown in drawing 12 
and drawing 13 shall be computed like processing of 5 and 6 here. 
[0072] 

SA=|B24-G(B24)A| (27) 
SB=|B24-G(B24)B| (28) 

G(B24) A in a formula (27) here As opposed to G signal on the 2nd Rhine in which B 
24-pixel location exists in processing of the above 5 G(B24) B in the signal value and 
formula (28) which were computed by performing a 1-dimensional interpolation 
operation in the direction of arrowhead A is the signal value computed to G signal on 
the 4th Rhine in which B 24-pixel location exists in processing of the above 6 by 
performing a 1-dimensional interpolation operation in the direction of arrowhead B. 
Thus, the computed variation SA expresses the signal value change in the direction of 
arrow-head A of B 24-pixel location, and Variation SB expresses the signal value change 
in the direction of arrowhead B of B 24-pixel location. 

[0073] The variations SA and SB computed as mentioned above are inputted into the 
weighting multiplier selection means 14. Hereafter, calculation of the weighting 
multiplier in the weighting multiplier selection means 14 is explained. In this operation 
gestalt, as fundamentally shown in the following formula (29), the weighting multiplier 
Sj is computed. 
[0074] 

Sj=SA/(SA+SB) (if SA+SB=0 then Sj=0.5) (29) 

In addition, since it is SA and SB>=0, in the case of SA=SB=0, it is set to SA+SB=0 in a 
formula (29). Here, in the arithmetic circuit which performs various operations, when 
operations are only addition, subtraction, and multiplication, comparatively few 
arithmetic elements can constitute a circuit. However, while many arithmetic elements 
will be needed and the configuration of a circuit will be complicated since an operation 
becomes comp heated if a division is included like a formula (29), an operation takes long 
duration. 

[0075] When computing the weighting multiplier Sj by the formula (29) and this is 
solved about the amount SB of fluctuation here, it is SB=(l-Sj) (/Sj) *SA. (29*) 



It becomes. It is shown that the relation between Variation SA and Variation SB is that 
this has the fixed weighting multiplier Sj in proportionality. Therefore, a setup of the 
two-dimensional flat surface which makes a x axis Variation SA and makes the y-axis 
Variation SB expresses the weighting multiplier Sj as a straight line which passes along 
the zero which has an inclination according to that weighting multiplier (except for 
SA=SB=0, i.e., a zero), as shown on this two-dimensional flat surface at drawing 14 . 
Hereafter, the abbreviation of the division processing in a formula (29) is explained 
using this relation. 

[0076] Drawing 15 is drawing for explaining calculation processing of the weighting 
multiplier Sj in the weighting multiplier selection means 14. in this operation gestalt, 
the weighting multiplier Sj is first shown in drawing 14 [ Variation SA and Variation SB 
being that the weighting multiplier Sj is fixed in proportionality, and the weighting 
multiplier Sj serving as a straight line which has an inclination according to the value 
in a SA-SB flat surface ] - as - Sj=0, 0.25, 0.5, and 0. - it quantizes to five steps of 75 
and 1.0. and it is shown in drawing 15 - as - a SA-SB flat-surface top -■ setting - a 
boundary [ 1 / Sj=0, and / 0.125, 0.375, 0.625, 0.875 and 1 ] - carrying out - five fields 
Al - A5 - setting up - each field Al - A5 - respectively - Sj=0, 0.25, 0.5, and 0. - it 
matches with 75 and 1.0. Here, in the case of Sj=0.125, SB=7SA and in the case of 
Sj=0.375, it is set [ SB=5/3SA, and in the case of Sj=0.625 ] to SB=1/7SASB=3/5SA, and 
in the case of Sj=0.875. 

[0077] Therefore, it can ask for the weighting multiplier Sj by making memory 14A 
connected to the weighting multiplier selection means 14 memorize as a table the 
relation shown in drawing 15 , and referring to this table based on the relation of the 
value of Variations SAand SB, without doing a division, as shown in a formula (29). For 
example, when the value of the computed variations SA and SB has the relation of the 
relation between 3/5SA<SB<=5/3SA, i.e., 3SA<5SB, and 5SA>=3SB, since Variations SA 
and SB are plotted by field A3 of the graph shown in drawing 15 , they can ask for a 
weighting multiplier as Sj=0.5. Since a field Al has a plot in having the relation of 7 
SA<SB, moreover, Sj=0, relation between 5/3 SA<SB<=7SA, Since a field A2 has a plot 
in being in the relation between 5SA<3SB and 7 SA>=SB, namely, Sj=0.25, relation 
between 1/7 SA<SB<=3/5SA, That is, since field A4 has a plot in being in the relation 
between SA<7SB and 3SA>=5SB, when it has the relation of Sj=0.75, and SB<=1/7SA, 
i.e., the relation of SA>=7SB, since it is in field A5, it can ask for a plot as Sj=l. 
[0078] In addition, although it is more desirable to quantize the weighting multiplier Sj 
more finely, when the operation time for decision of the field where Variations SA and 
SB exist is taken into consideration, it is desirable that they are about five steps. 



According to the experiment of these people, even if it quantizes to five steps, the false 
color reduction effectiveness is fully acquired. 

[0079] In the weighting addition means 15, a signal value is computed by following 
formula (30) - (32) about each case of 1, 2, 3 and 4, and 5 and 6. In addition, R (G33) 
signal in G 33-pixel location in the 1st Rhine where, as for formula (30) ■ (32), R and G 
pixels are located in a line in the direction of arrowhead A, respectively, In R (G35) 
signal in G 35-pixel location in the 2nd Rhine where B and G pixels are located in a line 
in the direction of arrow-head A, and the direction of arrowhead A, R (B24) signal in B 
24-pixel location in B and the 2nd Rhine where G pixels is located in a line is computed. 
[0080] 

R(G33)=(l-Sj)*R(G33)A+Sj*R(G33)B (30) 
R(G35)=(l-Sj)*R(G35)A+Sj*R(G35)B (31) 
R(B24)=(l-Sj)*R(B24)A+Sj*R(B24)B (32) 

In addition, the general formula using signals Ql and Q2 is shown in a formula (33). 
[0081] 

QR,QB=(l-Sj)*Ql+Sj*Q2 (33) 

By this, R and the B signals QR and QB will be computed by weighting with a bigger 
direction with few signal value changes being made. 

[0082] When calculation of B (R44) signal in R44 pixel sets to weighting multiplier 
Sj=0.5 here B(R44) =(l-Sj) *B(R44) A+Sj*B(R44) B=0.5*B(R44) A+0.5*B(R44) B (34) 
Although computed by carrying out, since the weighting multiplier is set up so that it 
may be set to Sj or l-Sj=l/2n (n is the natural number), in this operation gestalt, it is 
also possible to calculate by integer-izing using a bit shift like the following formula (35). 
[0083] 

B(R44)=(B(R44)A+B(R44)B+1)»1 (35) 

Here, when »1 expresses a signal value with a binary number, it expresses making 
right-hand side carry out one bit shift. Thus, in order to double a signal value 1/2 by 
making right-hand side carry out one bit shift, the operation equivalent to a formula 
(34) will be performed. In addition, in a formula (35), 1 is added for rounding off the 
result of an operation. 

[0084] In addition, if a pixel array is rotated 45 degrees in the veneer CCD 1 of the 
BEIYA array shown in drawing 2 (a), the pixel array will become the same if the 
honeycomb array shown in drawing 2 (b) and hole pixel location * are removed. 
Therefore, in the above-mentioned explanation, the RGB code in a total pixel location is 
computable like [ in a BEIYA array ] the case of a honeycomb array by making the space 
vertical direction [ in / for the direction of arrowhead A / drawing 2 ], and the direction 



drawing 20 shows calculation of the weighting multiplier Sj which uses a bit shift, and 
actuation of weighting addition. Moreover, in drawing 20 , calculation of B (R44) signal 
in R 44-pixel location is expressed. First, it is judged whether the sum of Variations SA 
and SB is 0 (step S2l). If step S21 is affirmed, B (R44) signal will be computed by the 
formula (35), using a bit shift as SA=SB=0.5 (step S22). 
[0089] 

B(R44)=(B(R44)A+B(R44)B+ 1)» 1 (35) 

Negation of step S21 judges whether it is SA>=7SB (step S23). If step S23 is affirmed, 
since the relation of Variations SA and SB is in field A5 of drawing 15 , it will be referred 
to as Sj=l, and B (R44) signal will be computed by the following formula (36) (step S24). 
[0090] 

B(R44)=B(R44)B (36) 

Negation of step S23 judges whether it is 3SA>=5SB (step S25). If step S25 is affirmed, 
since the relation of Variations SA and SB is in field A4 of drawing 15 , it will be referred 
to as Sj=0.75, and B (R44) signal will be computed by the following formula (37) (step 
S26). 
[0091] 

B(R44)=(B(R44)A+3B(R44)B+2)»2 (37) 

Negation of step S25 judges whether it is 5SA>=3SB (step S27). If step S27 is affirmed, 
since the relation of Variations SA and SB is in field A3 of drawing 15 , it will be referred 
to as Sj=0.5, and B (R44) signal will be computed by the formula (35) (step S28). 
[0092] Negation of step S27 judges whether it is 7 SA>=SB (step S29). If step S29 is 
affirmed, since the relation of Variations SA and SB is in the field A2 of drawing 15 , it 
will be referred to as Sj=0.25, and B (R44) signal will be computed by the following 
formula (38) (step S30). 
[0093] 

B(R44)=(3*B(R44)A+B(R44)B+2)»2 (38) 

And if step S29 is denied, since the relation of Variations SA and SB is in the field Al of 
drawing 15 , it will be referred to as Sj=0, and B (R44) signal will be computed by the 
following formula (39) (step S31). 
[0094] B(R44)=B(R44)A (39) 

drawing 18 - return, and R and B - when it is judged whether all the signals were 
computed (step S5) and step S5 is denied, the B signal QB is computed by setting to B 
signal the signal computed in step S6, returning to step S4, and repeating step S4 and 
processing of S5. 

[0095] In the check square interpolation means 5, the signal value in a hole pixel 



location is computed by performing the check square interpolation operation by the 
interpolation filter shown in drawing 16 or drawing 17 to the signal value of each pixel 
(step S7), and processing is ended noting that RGB codes QR, QG, and QB will be 
computed in all pixel locations other than a hole pixel location, if step S5 is affirmed. 
[0096] And the RGB code in the total pixel location which includes by this the hole pixel 
location of the veneer CCD 1 by the honeycomb array shown in drawing 2 (b) can be 
obtained, and the interpolated image data SI which has an RGB code in a total pixel 
location can be obtained. 

[0097] In addition, in step S3 of the flow chart shown in drawing 18 , although the 
signal to compute is set to R signal, you may set to B signal first. In this case, when step 
S5 is denied, in step S6, the signal to compute will be changed from B signal to R signal. 
[0098] Thus, the operation time can also be shortened while being able to make simple 
the configuration of the equipment for being able to make simple the configuration of 
the circuit which computes the weighting multiplier Sj, consequently carrying out this 
operation gestalt, since according to the 1st operation gestalt a division is not done in 
case the weighting multiplier Sj is computed. Moreover, since it can calculate in an 
integral value by performing a bit shift, it is calculating simply and the processing time 
can be shortened. Therefore, it becomes easy to carry the equipment for carrying out 
this invention in image readers, such as image pick-up equipments, such as a digital 
camera, and a scanner, or a printer, and, thereby, highly efficient equipment can be 
created. 

[0099] In addition, although weighting addition is performed using the bit shift, in the 
weighting addition means 15, it may be made to perform weighting addition shown in 
the above-mentioned formula (33) in the operation gestalt of the above 1st, without 
performing a bit shift using the weighting multiplier Sj computed in the weighting 
multiplier selection means 14. 

[0100] Subsequently, the 2nd operation gestalt of this invention is explained. Drawing 
21 is the outline block diagram showing the configuration of RB interpolation means of 
the image processing system by the 2nd operation gestalt of this invention. In addition, 
in drawing 21 , the reference number same about the same configuration as drawing 5 
is attached, and detailed explanation is omitted. A judgment means 10 to judge whether 
the pixel location which presumes a signal value is in a gray edge in the 2nd operation 
gestalt, or it is in a color edge, Based on the judgment information H showing the 
judgment result in the judgment means 10, the point equipped with a variation 
calculation means 23 to compute the value showing the amount of fluctuation of the 
signal value in the direction of arrowhead A and the direction of arrowhead B as 



variations SA and SB differs from the 1st operation gestalt. 

[0101] It judges whether the judgment means 10 has the pixel location which presumes 
a signal value as is the following in a gray edge, or it is in a color edge, drawing 22 - red 
(R) - and green - drawing showing the example of the color edge which consists of (G), 
and drawing 23 are drawings showing the example of the gray edge which consists of 
white and black. In addition, in drawing 22 and 23, a signal value shows the pixel 
location of 0 by void, and the other pixel is explained as that whose signal value is 255. 
Moreover, a judgment in R 44-pixel location is explained here. First, the judgment 
means 10 calculates the decision values DatlDat4 of an edge by (43) from the following 
formula (40). 
[0102] 

Datl= | R44-G33 I + 1 R44G55 I + I G35-B24 1 + 1 G35-B46 I (40) 
Dat2= | R44-G33 1 + 1 R44-G55 | + | G53B42 | + 1 G53-B64 1 (41) 
Dat3= I R44-G35 | + 1 R44-G53 | + | G33-B24 1 + I G33-B42 | (42) 
Dat4= | R44G35 1 + 1 R44-G53 I + 1 G55-B46 I + | G55-B64 1 (43) 

Here, a formula (40) computes the decision value Datl forjudging the color of the edge 
of the upper right part of R 44-pixel location in the direction of arrowhead A, and a 
formula (41) computes the decision value Dat2 for judging the color of the edge of the 
lower left part of R 44-pixel location in the direction of arrowhead A. Moreover, a 
formula (42) computes the decision value Dat3 for judging the color of the edge of the 
upper left part of R 44-pixel location in the direction of arrowhead B, and a formula (43) 
computes the decision value Dat4 forjudging the color of the edge of the lower right part 
of R 44-pixel location in the direction of arrowhead B. 

[0103] When the pixel location which presumes a signal value is in a gray edge, as for 
any one of the above-mentioned decision values Datl-Dat4, a value surely becomes 
small. For example, in the case of the gray edge shown in drawing 23 , in the decision 
values Datl-Dat4 computed in above-mentioned formula (40) - (43), the decision values 
Datl and Dat2 are set to 0. When it is in a color edge as the pixel location which 
presumes a signal value shows to drawing 22 on the other hand, any value of the 
above-mentioned decision values Datl-Dat4 becomes large. Therefore, Dmin=min(Datl, 
Dat2, Dat3, Dat4) <=T when the minimum value Dmin is below the threshold T as 
compared with the threshold T which was able to define beforehand the minimum value 
Dmin of the decision values Datl~Dat4 (44) 

It comes out and, in a certain case, judges that the pixel location is a gray edge, and 
when other (i.e., Dmin=min(Datl, Dat2, Dat3, Dat4) >T), it is. (45) 

It comes out and, in a certain case, judges with it being a color edge. Here, as a value of 



a threshold T, when a signal value is expressed with 8 bits, it considers as about 128 
value. And the judgment means 10 is inputted into the variation calculation means 23 
by making this judgment result into the judgment information H. 

[0104] In the variation calculation means 23, Variations SA and SB are computed by [ as 
it is the following ] based on the judgment information H. First, calculation of the 
variations SA and SB for computing the weighting multiplier of the arrow head A 
computed by processing of 1 and 2 and R signal of the direction of B is explained. When 
judged with the pixel location which computes a signal value using the judgment 
information H being in a color edge, the variation SA about the direction of arrow-head 
A and the variation SB about the direction of arrow-head B are computed by the 
following formula (46) and (47). In addition, the variations SA and SB of the signal 
value in G 33-pixel location shown in drawing 8 shall be computed like processing of 1 
and 2 here. 
[0105] 

SA= | R(G33)A-G33 | /(R(G33)A+G33) (46) 
SB= | B(G33)B-G33 I /(B(G33)B+G33) (47) 

When judged with on the other hand the pixel location which computes a signal value 
using the judgment information H being in a gray edge, Variation SA and Variation SB 
are computed like the 1st operation gestalt by the formula (23) which omitted the 
denominator of a formula (46) and (47), and (24). 
[0106] 

SA= I R(G33)A-G33 I (23) 
SB=|B(G33)B-G33| (24) 

Next, calculation of the variation for computing the weighting multiplier of the arrow 
head A computed by processing of 3 and 4 and R signal of the direction of B is explained. 
[0107] First, when judged with the pixel location which computes a signal value using 
the judgment information H being in a color edge, the variation SA about the direction 
of arrowhead A and the variation SB about the direction of arrowhead B are computed 
by the following formula (48) and (49). In addition, the variation of the signal value in G 
35-pixel location shown in drawing 10 shall be computed like processing of 3 and 4 here. 
[0108] 

SA= I B(G35)A-G35 I /(B(G35)A+G35) (48) 
. SB= | R(G35)B-G35 | /(R(G35)B+G35) (49) 

When judged with on the other hand the pixel location which computes a signal value 
using the judgment information H being in a gray edge, Variation SA and Variation SB 
are computed by the formula (25) which omitted the denominator of a formula (48) and 



(49), and (26). 
[0109] 

SA=|B(G35)A-G35| (25) 
SB= | R(G35)B-G35 | (26) 

Next, calculation of the variation for computing the weighting multiplier of the arrow 
head A computed by processing of 5 and 6 and R signal of the direction of B is explained. 
[0110] First, when judged with the pixel location which computes a signal value using 
the judgment information H being in a color edge, the variation SA about the direction 
of arrowhead A and the variation SB about the direction of arrowhead B are computed 
by the following formula (50) and (51). In addition, the variation of the signal value in B 
24-pixel location shown in drawing 12 and drawing 13 shall be computed like processing 
of 5 and 6 here. 
[0111] 

SA= | B24-G(B24)A | /(B24+G(B24)A) (50) 

SB= | B24-G(B24) B | /(B24+ G(B24) B) (51) <BR> When judged with on the other hand 
the pixel location which computes a signal value using the judgment information H 
being in a gray edge, Variation SA and Variation SB are computed by the formula (27) 
which omitted the denominator of a formula (50) and (51), and (28). 
[0112] 

SA=|B24-G(B24)AJ (27) 
SB=|B24-G(B24)B| (28) 

Here, the difference in the calculation approach of the variations SA and SB in the case 
of a color edge and a gray edge is explained. Drawing 24 is drawing for explaining the 
difference in the calculation approach of Variations SA and SB. In the pixel array shown 
in drawing 24 , white (a signal value is 255) and a black (value with the signal value 
near 0 or 0) gray edge shall be expressed. In addition, here explains calculation of B 
(R44) signal in R44 pixel. First, B(R44) A signal of R 44-pixel location is searched for by 
the following formula (52) about the direction of arrowhead A. 
[0113] 

B(R44)A=G(R44)A+((B(G35)A-G35)+(B(G53)A-G53))/2 =0+((2-0)+(255-255))/2=l (52) 
However, it is G(R44) A=0, B(G35) A=2, and B(G53) A=255, and the 1 -dimensional 
Cubic spline interpolation operation as shown in a formula (12) and (20) was used for 
calculation of these values. 

[0114] Moreover, B(R44) B signal of R 44-pixel location is searched for by the following 

formula (53) about the direction of arrowhead B. 

[0115] 



B(R44B)=G(R44)B+((B(G33)B-G33)+(B(G55)B-G55))/2 =103+((l05-0)+(l05-0))/2=208 
(53) 

However, it is G(R44) B**103, B(G33) B**105, and B(G55) B**105, and the 
1 -dimensional Cubic spline interpolation operation as" shown in a formula (12) and (20) 
was used for calculation of these values. 

[0116] And Variations SA and SB are calculated by the following formula (54), and the 
weighting multiplier Sj for carrying out weighting addition of B(R44) A signal and the 
B(R44) B signal by the formula (55) is computed. 
[0117] 

SA= | R44-G(R44) A | /(R44+G(R44) A) = 1 1-0 1 /(l+0) =1 SB= | R44-G(R44) 
B | /(R44+G(R44) B) = | 1-103 I /(1+103) **0.98 (54) 
Sj=SA/(SA+SB) =1/(1+0.98) **0.5 (55) 

Thus, if the weighting multiplier Sj is called for, B (R44) signal will be computed by the 

following formula (56). 

[0118] 

B(R44) =(1-Sj) *B(R44) A+Sj*B B= 0.5*1+0.5*208**105 (R44) (56) 

Here, since R 44-pixel location is on a black edge, as for the value of B (R44) signal, it is 
desirable [ location ] that it is a value near 0. However, since the value will be set to 105 
if the weighting multiplier Sj is computed and the value of B (R44) signal is calculated 
by the formula (56) as shown in the above-mentioned formula (54) and (55), a false color 
will occur here. This is because the weighting multiplier Sj may not serve as a value 
near 0 as shown in a formula (56) depending on the signal value in the pixel location 
around a pixel location which computes a signal value, although the value of the 
weighting multiplier Sj becomes close to 0 so that there is little fluctuation of a signal 
value in the direction of arrowhead A. 

[0119] On the other hand, when the pixel location which computes a signal value is in a 
gray edge in the 2nd operation gestalt When Variations SA and SB are computed by 
omitting a denominator in a formula (54) and Variations SA and SB are computed such 
in R 44-pixel location, it is SA= | R44-G(R44) A| = 11-01=1. SB= | R44-G(R44) 
B | = | 1-103 1=102 (57) 

Next door and weighting multiplier Sj Sj=SA/(SA+SB) =1/(1+102) **0.01 (58) 
It becomes. Thus, when B (R44) signal is computed with the computed weighting 
multiplier Sj, it is. B(R44) =(1-Sj) *B(R44) A+Sj*B B= 0.99*1+0.01*208**2.99 (R44) (59) 
It becomes. Thereby, B (R44) signal serves as a value near 0, and, as a result, can reduce 
a false color. 

[0120] On the other hand, when judged with it being a color edge, even if it computes 



calculation (step S43) of the signal value by processings 5 and 6 are performed like the 
1st operation gestalt. 

[0125] It is judged whether on the other hand in the judgment means 10, the pixel 
location which computes a signal value is in a gray edge (step S44), and the judgment 
information H showing the judgment result is inputted into the variation calculation 
means 23. In the variation calculation means 23, when the pixel location which 
computes a signal value is in a gray edge, as shown in the above-mentioned formula (23), 
(24), etc., the variations SA and SB for gray edges are computed (step S45). Conversely, 
in being a color edge, as shown in the above-mentioned formula (460 etc. (470, it 
computes the variations SA and SB for color edges (step S46). And the R signal QR is 
computed by Variations SA and SB being inputted into the weighting multiplier 
selection means 14, the weighting multiplier Sj being chosen with reference to the table 
memorized by memory 14A like the 1st operation gestalt, and weighting addition of the 
signal value computed by processing of steps Sll, S12, and S13 being carried out using 
a bit shift (step S47). In addition, of course [ without performing a bit shift ], it may be 
made to perform weighting addition shown in the above-mentioned formula (33). 
[0126] Thus, it judges whether according to the 2nd operation gestalt, the pixel location 
which computes a signal value is in a gray edge, or it is in a color edge, and a false color 
can be reduced even if it is the case where the pixel location which computes a signal 
value is in a gray edge, since the calculation approach of the variations SA and SB for 
computing the weighting multiplier Sj according to a judgment result was changed. 
Moreover, when the pixel location which computes a signal value is in a color edge, the 
image which leaves the fine tint in near an edge and serves as natural sensibility can be 
obtained. 

[0127] Here, in the image pick-up equipment which used the veneer CCD 1, in order to 
reduce a false color, in the image pick-up system for obtaining image data, it is 
necessary to use an optical low pass filter. Drawing showing the image pick-up system 
of the digital camera with which drawing 26 used the veneer CCD of a honeycomb array, 
and drawing 27 are drawings showing the frequency characteristics of the signal value 
acquired in the veneer CCD of a honeycomb array. In addition, by drawing 27 , fs/2 are 
Nyquist rates and the frequency band which can reproduce the continuous line in 
drawing 27 (a) by the conventional processing, and the frequency band which can 
reproduce the continuous line in drawing 27 (b) by processing of this operation gestalt 
are shown, respectively. As shown in drawing 26 , a taking lens 31, the optical low pass 
filter 32, and the veneer CCD 33 of a honeycomb array are arranged sequentially from a 
photographic subject, and the image pick-up system of a digital camera becomes. In 



addition, X shows an optical axis. In the approach indicated by above-mentioned 
JP,lO20906,A, 10-136391, etc., since the reduction effectiveness of a false color is 
inadequate, it is necessary to use the narrow optical low pass filter 32 of the band for 
cutting the frequency band outside the continuous line" shown in drawing 27 (a). 
However, use of the narrow optical low pass filter of such a band reduces the resolution 
of the image obtained. Moreover, in order to create the narrow optical low pass filter 32 
of such a frequency band and to make three quarter-wave length plates with a main 
wavelength of about 630-785nm rival as shown in drawing 28 (a), the configuration of 
an image pick-up system is enlarged. 

[0128] According to this invention, since a false color can be reduced as compared with 
the conventional approach, the frequency band of the optical low pass filter 32 can be 
extended as shown in drawing 27 (b), and the resolution of the image expressed by this 
by the image data SO obtained in the veneer CCD 33 can be raised. Moreover, since the 
property shown in drawing 27 (b) by making two quarter-wave length plates rival can 
be acquired as shown in drawing 28 (b), an image pick-up system can be miniaturized. 
[0129] In addition, although that in which G pixels has a double consistency to R and B 
pixels as a veneer CCD 1 in the above 1st and the 2nd operation gestalt was explained, 
as opposed to G and B pixels, B pixels may have [ R pixels ] a double consistency to R 
and G pixels. Moreover, although what has spectral sensitivity to R, G, and B was 
explained, as a veneer CCD 1, it is not limited to this, and you may have spectral 
sensitivity to the thing which has spectral sensitivity to Y (yellow), G (Green), and C 
(cyanogen), or Y, W (White) and C. 

[0130] Moreover, although the signal values of all three colors are computed, you may 
make it compute the signal value of only one color or two colors in the above 1st and the 
2nd operation gestalt. 

[0131] Furthermore, in the above 1st and the 2nd operation gestalt, although the 
weighting multiplier Sj shall be computed by the formula (29), it is good also as what 
computes the weighting multiplier Sj by the following formula (60). 
[0132] 

Sj=SB/(SA+SB) (if SA+SB=0 then Sj=0.5) (60) 

In this case, the correspondence relation between the weighting multiplier Sj and 
Variations SA and SB will be specified on the two-dimensional flat surface which made 
Variation SB in the direction of a x axis, and was made into Variation SA in the 
direction of the yaxis as shown in drawing 29 . 

[0133] Moreover, R and the B signals QR and QB are computed by the following formula 
(61) in this case. 



[0134] 

QR,QB=Sj*Ql+(l-Sj)*Q2 (61) 
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[Drawing l] The outline block diagram showing the configuration of the image 
processing system by the 1st operation gestalt of this invention 
[Drawing 2] Drawing showing the pixel array in Veneer CCD 

[Drawing 3] Drawing showing the pixel array of the veneer CCD of a honeycomb array 
[ Drawing 4] Drawing in which giving a reference number and showing each pixel 
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[Drawing 5] The outline block diagram showing the configuration of RB interpolation 
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[Drawing 6] Drawing showing the example of a Cubic spline interpolation filter 
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[Drawing 8] Drawing for explaining calculation of a signal value (the 2) 

[Drawing 9] Drawing for explaining calculation of a signal value (the 3) 

[ Drawing 10] Drawing for explaining calculation of a signal value (the 4) 

[Drawing 11] Drawing for explaining calculation of a signal value (the 5) 

[Drawing 12] Drawing for explaining calculation of a signal value (the 6) 

[Drawing 13] Drawing for explaining calculation of a signal value (the 7) 

[Drawing 14] Drawing showing the relation between Variations SA and SB and the 

weighting multiplier Sj 

[Drawing 15] Drawing for explaining processing of the 1st operation gestalt 
[Drawing 16] Drawing showing the example of a check square filter (the l) 
[Drawing 17] Drawing showing the example of a check square filter (the 2) 
[Drawing 18] The flow chart which shows actuation of the 1st operation gestalt 
[Drawing 19] The flow chart which shows actuation of signal calculation processing 
[Drawing 20] The flow chart which shows actuation of the weighting addition 
processing using a bit shift 

[Drawing 21] The outline block diagram showing the configuration of RB interpolation 
means in the image processing system by the 2nd operation gestalt of this invention 
[Drawing 22] red (R) ~ and green - drawing showing the example of the color edge 
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G 1 7, G31, G33. G35. G37. G51, G 
53, G55, G57, G71, G73, G75, G7 
7) (DGmmcttLX, 06{C/TTf 2#7nCubicX:/^ 

f y mm y * >i z k «t o 7 -f ;i/ * u y y «a*at -r c t 

tCfcOJWHSnSo -73, B4 6IM1TOG (B 4 
6) «#{4, »«TfflA,7£f-©HH0Giia{iB (G 1 
3, G 1 5. G 1 7, G 1 9, G 3 3, G 3 5, G 3 
7, G39, G5 3. G55. G57, G59, G7 
3, G7 5. G7 7, G 7 9) ©GB*f£*f LX, mm 
}\>?Vy<f9B.m*MT£tlc&K>Wtii-£n%o c 

ci:&<«£:fT 5 c coes, £T£>HiR 

ffiBt*v^T7coa»aw ltc g a^*a* c 

[004 2] CCX\ ffifflmW<D¥&tLXtt®4ia3 

s^ffifcta/rrscfctf-ess. Ga^%ata 
-r ^ wmmmm<D g iaaffiBtc *v ^ti§ e n « g a^ 

muLmicmt^c m^nm lx t «t^ 0 m« 0 7 tc 

*JVTa»THAy^R 4 4jBaffiBTOG (R 4 4) fl 
^feith'B 4 6B*ttB"eOG (B 4 6) {f*f{4, Z<D 

mw<DA -d(dg mmGLSicMfz g ms^zm^xT b<d 

S(10), (1 1) fCfcOgajLTt^o 
[0 0 4 3] 

5 3 + G 5 5) /4 (1 0) 

5 5 + G5 7) /4 (11) 

(B) ZtttZ&(DttZo £fc> ^ 
91A73lnJtR, GIim*7^^1(?)7-i'X $5 

SiAftmcB, Gmmtftt.& ; 7'(yzm2<D7-(y. & 

EPBTjlpJlCB, Gii«* ,: >l6^7-i'>^4©7^>i:-r 

So 

[0 0 4 5] mi £>7^>fc£tt3£fflA77|nJ{C'O^T 

<DGHatiB»i:fe»tsRa#<DaasQ ! at4, ^-©Gis^ 

BKfettSHIi-eia/u^G 3 3iB^{uBT-«DR (G 3 



15 



3) Amm*. G3 3ii*<4B*^a-rs»i(D7-r^ 

±<DG 3 3mm&.Wffl21<D4&<DRWm (R 0 0, R2 
2, R44, R6 6) Kfct^Tli&n* RB^fcJtL 
T. TIB<0^ (1 2) lent lXfT&iblcX7?<(vm * 

R(G33)A=(-3*R00+19*R22+19*R44-3*R66)/32 

(DRS^iSBtC^ltSR 2 2, R 4 4 flHt*ffi^TTI28$ 
R(C33)A=(R22+R44)/2 

[0 0 4 8] 2&K» ^01A73i6]{Cfc^TR, GM*# 

en b ^iRitot^Toe^owaitts 2 *i f^is 1 2 

$.tt>% 0 Mz.lt. CCT'«09tC^-ril^T'HA.fc:G 3 20 

3H3i{£ii?-<DR (G3 3) BfgTOsttit- 3&cD^:-f 
3 g 3 3 mmtiLWim&-?zmm{tmiiQmx*®h. 

tcR 2 2H*ffiBfe«fctfR 4 4H^feli:^5 0 ^LT 
COR2 2iB*fl[BK:*5ttSR2 2fi^fcG (R2 2) 
B^fc©gfcJ:tf R 4 4B*fflBfcfett«R 4 4 fS^i: 

c (r 4 4) \mt<Dm<D¥mm. c 3 saxttBtc 

G 3 3 filing U *©AnJtt!i£% G 3 3 Bfl 
ttfiKfcttSR (G3 3) BB^fcfS. 
[0 0 4 9] CCT\ R2 2ifOft*ffl^ftlB, G 
3 3 H*ffiH"eo R ( G 3 3 ) B B^tiTSEOiS ( 1 30 

4) lCcfct>mb$ft3o 
[00 5 0] 

R(C33)B=G33+(R22-G(R22)) (14) 
4*, S (l 4) fiiS»<DJam«ftfiH«{c*JttSRi3^ 

<DT*;)53 0 0J*tf, R 2 2B*ffiB*5«fctfG 3 3HUH4 
BT'tO R fl^ t G fl^f <D|§#qp L^tlt. 
R(G33)B-G33=R22-G(R22) (15) 
(DSm^fStfctt^oCtr'So*). S(15)*R (C 
3 3) Binmc-D^TM^fri><DffjK. (1 4) t%5 0 40 

S (1 4) £i5V>TG (R2 2) ff*§t±, ±12 
(1) 0#tefc£9Jliti£l'lfcfc<*m±a<, R22B 

jRfflB^ft-rssac^-r^oGffl^eWLT, £ 

EPB'tflfijfcTiSOiS (16) te**««ffiHJ»J|-»?>£ 

(12) tc7ji?i9:7ic\ibicx77'{>ffimmnmcDi 

fci'o^ G (R2 2) ffl^{Ctt#BgflFif BtfttSttS 
[00 5 1] G(R22)B=(G31+C13)/2 (16) 

s (H) r-{±, mm<ommm%ffimc}3V 50 
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* rsmwmo) 1 ^TcffiBgistUfcasf c tic* oism^n 

So 



[0 0 4 6] 

(i 2) 

(1 3) {CiOmtiLTfccfc^o 
[0 0 4 7] 

(1 3) 

J* iRjfcfcl^T G 3 3 BJRttH^fiFtEfSS 4 ©7^ > 

nti. S3fc<fctf£4©7-r:'±K&sH*fflfl!)fflMM 

tS^T, R2 2g^<D*»ft«^, G3 3BS8&B 
T'COR (G3 3) Bfi*ffi±f2s£ (15) K^-rBMSt 
StJl^TSmSftSflV G (R2 2) BWFUHTfcS 

cft*Jt£-f*&g*tfc3o ::t% s (i 5) 
iffi 3 ^<fc tf m 4 <d 5 yfflic mf z ffimmm*m l x 

^Sfcib, G (R2 2) m3<D? 

ftstf&s. c©«^ ±te (i) co^?£tc ctosmt 
fc g fi^^^ffl -r -5 c i: a m t>\ c <o g mmt 

S (i o) , (ii) fc^fck^ SijcDv'('>'<Dfi% 

•es/ctfHc, ^ (16) <D<J:5fcif?3cD7--<:y±£fci,> 

(R2 2) BB^*JHHl/tVSt>©Tifc5o 
[0 0 5 2] -7?, R 4 4fi#©**ffll/^i:, ±12^ 

(i 5) (ommcm^r, g3 3h^©bt*or (g 

4 4) BB^«TI3«S (l 7) lc£*)W-m-£tiZ>c 
[0 0 5 3] 

R (G33) B=G33+ (R44-G (R44) B) (17) 

afe, g (R4 4) Bfs^tis (i 6) tmmicmmz 
tiZo ccx\ *nm&mas^xii. s (14) 

l/Hi (1 7) eD^-ftt7WC<fcDR (G3 3) BfI^«rJ)< 

momma* m^tc(DX' its mwvDfamtfzcDftmciB. 

fcTL^= cn^K±T5fc46(c, TIS^)^ (1 
8) {c^-Ti^tc, Rig^Uffif 4GliJR(4B (0U 

if g 3 3H^{iB) (Dmmomm&m (r 2 2, r 4 4 

HltftB) tc*5^5R®^i:Gfi^i:cDMO¥^ffi^ 

r ft ^*wm-r ^ g BjRffcBfcfeW' 5 g mmznm lk. 

t O*, ^© G H jfifflSK fett S R B^ i: Lfc 1 
[0 0 5 4] 
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R (G33) B=G33+ ( (R22-G (R22) B) + (R44-G (R44)B) ) /2 



(1 8) 



<DR (G3 3) BimZWltitZCttfTZZo 
[0 0 5 5] 3*K, ^ePAT^Cfc^TB, CBfStf 

Q}Mjmc-D^r<oim<Dwmm i mrn^m i 1 
c ct?h:h i oic^-rnaiTffl^^G 3 shuhuBt*© io 

R (G3 5) A^**ai-r*t>©i:-r5i:, G3 5H* 

R (G35) A=G35+ ( (R26-G (R26) A) + (R44-G (R44 ) A) ) /2 



Hfe<fctfR 4 4BiSlftg£:&3o *LT±l22©jOJIfc 
T£©S (19) fcSrf idfc, R2 6Hfttt 
2 61t*f£G (R2 6) A«%fc0i§*5«fc 
tfR 4 4 H^fiStCfctt-S R 4 4€^tG (R4 4) A 
<mt(Om(D¥-mm, G 3 5B£ftlfc*5tt3G 3 5 

mmcijaw-L, *<Dtmmm%G 3 sBiit&Hfcfctts 

R (G 3 5) Af§^i:-f S„ 
[0 0 5 6] 



(1 9) 



&fc> G (R2 6) Aft^fc'it/G (R4 4) Afg^t 
«\ R 2 6fc«ttfR 4 4BffiftlI##£-f 1 O^-l" 

{C<fct>, fcfflA7ifa£OI,*Ta)GiH*{aBT<DR (G 3 
5) Afg^fcmm-f 5 CttfT't So 
[0 0 5 7] 4*IC, 55BJA75rfilK:i3^TB, GBsfitf 
M^S2<D^Y>iCfett5GH^{4HT'©, fcfllB73lRj 20 
{CONT'D R{S^cD»WfflStO^T»f3 0 CCD^ 

fcl^T, G B^fetSTb^Sns^ 3 (D? -( y ±.Ktsx 

R(C35)B=(-3*R08+19*R26+19*R44-3*R62)/32 



fffrn^o 0U*.«\ 01 UC*5tt5lliK8T'HAv/'cG 3 5 

B^iasT'^R (G3 5) Bmmt. G3 5mmimff 
ft&t5>m3<v ; 7'<y±i,c}stfz>G 3 smmimmm^ 

4£<DRBH(R08, R26, R44, R 6 2) E& 

^Tf#en« Rft^cWLT, i offlatrattt 1 #tc 
7yjyM®mnic£%mtii<DmzTm<Di& (20) t 

[0 0 5 8] 



(2 0) 



5*E, JsfllA^lSHC^^TB, GB*^M^2 005 
■< yiZiSlfZ B B^uST-^^ffl A7?[p1(COV^TcD R ft 

Tcote^cogaitim 1 sira^s 1 1 icfe^rfr t>*x5„ 

TSSSfSH^S^feSc M^ti ccxim\ 2 30 
t^f^lft-pfflA,^ B 2 4 B*fiST-£D R (B 2 4) A 

fi^sa-rsfcat-rsfc, b 2 4®m{u.wicm&? 

SHSHfclttfiSISTHAJSG 1 5BMRffifiM3«fctf G 3 3* 

R(B24)A=G(B24)A+((R(G33)A-C33)+(R(C15)A-Gl5))/2 
443, R (G 1 5) Aff^fcitfR (G3 3) A{§# 

(i, g 1 5*3j;tfG 3 3wmikmtfwtEt%>m 1 07^ 

:x±E:fctt£R{f*f{c*fLT, £EPA7?ftfC 1 ^Ttlfffl 

fc^T»WLfcRffi^*0fc<DT*fc.5 o £fc, G (B 2 
4) A<S*f«, B 2 4B*fiH^&-r§^2£D7-r> 40 
±(Cfctt^GfI^(cWbT^E[lA^f6](C 1 #7cffiM»» 

0, ^01A^{COVTCOBB^fiiST'©R (B2 4) 
AfI^SttJT5c:i:^T't5o 
[0 0 6 0] 6*t, ^9lA?j|pJ{Ct5V>TB, Gil^ 
M^'S >{C*5tt3 B B«(4»T-(D^en B 73 [pUC 

b fimc^xcDimowmm 2 mrs^m 1 2 

R(B24)B=G(B24)B+((R(G35)B-G35)+(R(G13)B-G13))/2 (2 2) 
R (G 1 3) Bfl^fcitfR (G 3 5) B{§*§ 50 tt % G 1 3i3«ttf G 3 5l 



★ H3RfilBi:*S. j eLT±3B2©*!yii:|Bi«fc, 
a (21) (C^-Tcfc3{c> G 1 5B*fuK(cfctt5R 

(G 1 5) Aff^f £C 1 5{i#£<E>M*5J:0*G 3 3B« 
tftfitCfcttSR (G3 3) Aff^-^G 3 3{§^fi:<DMtf) 
¥£ffi*. B 2 4H*{fcBfcfettSG (B 2 4) Afl^f 

(B 2 4) k\mt?z> a 

[0 0 5 9] 

(2 1) 

#TfTfr*i3„ sr, RM#£»ffl-t5BBf?tftKK£EP 
A55Tfil{i:feV^TR»-r«Bi*fl[|l**46S. 0tj*tf, C 
C X&m 1 3 tC^-rH^TH/u/c B 2 4 BSsfiBT'tf) R 
(B2 4) BiS^«r'»m-rStOi:-rSi:, B2 4II 

ffiB(cm»-r«in«ffiB»tt«'pHA,^G 1 3B*fes 

fcitfG 3 5B*{4§i:&£o *LT±i22 0fflai:ll 
«t, TIBOxS (2 2) fC^TJ:?{C, G 1 3B*feg 
fclSlfZR (G 1 3) Bff^iG 1 3ff^i:CDSt5«J;D* 
G 3 5 B^luli &tt S R (G3 5) Bfg*§i:G3 5fI 
B 2 4B»fig(C*5tt§G (B2 

4) Bfi^t^L, tamim^B 2 mm&mic 

fettSR (B 2 4) B{g*f£1-3 0 
[00 6 1] 



(11) 
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[0073] «±©<fc5£*aiSftfcsaftffis a 

OS (2 9) fcii***5fcS#fl-ttflWS j 
3o 

[0 0 7 4] 

Sj=SA/(SA+SB) (if SA+SB=0 then Sj=0.5) ( 
x£ (2 9) fC*5l>TS A+S B = 0 t&Z 
SA, SB^OT^SCt^e, SA = SB = C 

So LfrLfctf^ S (2 9) OiatBW^ 

[0 0 7 5] llT\ fi*Mtt«»S j G 
SB=((l-Sj)/Sj)*SA (2 9') 

^LTl/>3o L/ctfot, xttfcSKiffiSA* ' 
SHIS B£-tZ2&7i¥ft%mfe-?Zt, ceo: 

(S A=SB = 0-T4t>%iajS*IS|f<) 

[0076] hi 5im&mmmmiR¥®. i 
s i: s a t mam SBt titttHBarati: ; 

A-S B¥ffiJC455«/^TttS*Wt«aS j 

£-?mfrttim®s j ^0 1 4 tc^ti^fc s 

0. 2 5, 0. 5, 0. 7 5, 1 . 0©5gPi. 
"TSo LTv 01 5fC?fx-f ±5(CS A-S B ; 
fc^TS j =0, 0. 125, 0. 375, 0. 
5. 0. 8 7 5, I**!lfcLT5O<0®«A 
*KSU &nliS?A 1 ~A5%fnfns j = 

2 5, 0. 5. 0. 7 5, 1. OfCifrSttttS. 
T\ Sj=0. 1 2 5 <Dl§a S B = 7 S A > S 

3 7 5 SB=5/3SA, S j = 0 . 6 
&SB = 3/5SA< S j =0. 8 7 5£OtI^- 
/7 S At&£ 0 

[00 7 7] Lft^oT, M*fiftt«SeaS3¥ 
SiSft/i^tll 1 4Afi, 01 StCarfllfHI 
B(R44)=(l-Sj)*B(R44)A 



20 
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fe^T»WLfeRfflffOt,©T?J65 0 G (B 2 

4) Bismt, b 2 4mmnm^n&-r^m4<D^^ y 

ctO, ^HJB^(RlKOl,^T©BH3R£aKT?©R (B 2 
4) Bfl^gtb-r§ci:^T'#5o 
[0 0 6 2] W±, 1 ©tefifcj:^ ^EPA^Cfc^ 

<D*EP A 7? IrI (COSTCO R ff^AWfcH £ ti, 2 CD&IItC 
<£ ^ ^EPA7jfS]fC}3^TR, GlS* , ii*gi07'C 
G li^figTcD^Ef] B 55|6jfCO^T© R 

[0 0 6 3] 3©iElIfc«fc{) % ^0]A77fpJ(C*5^ 

TB, GjB^M^2^7-OfC*ilt5Giii^ffiHT* 

co^eriA^(R]{co^T<DR{g^»tB$n, 4offla»c 
>{cfccts c mmumx'CDttn b 77 iskc^^tid r \m 

[0 0 6 4] J^fc, ScDiaiifCck?), *9lA2FlRjfcfe 
^TB, G H^^M^ 2 ©7^ >t4ott-5 B iijRtifB 

"e^epA^riBifcoi^TORM^gtti^ti, 6©jan 

JC«t»), &ff]A73|nJ{C*5l^TB, G 2 ©-7 

Y >»C fcttS B HfgftgTO^EP B 73 ib]\C-D^X<D R ft 

[0065] &mm&mic$5if%%:WA, emx 
[0066] ^mmm&^m 1 3«\ ti&K-f sa^wt 

«»aHR^S 1 4 fc*i^T\ 1 i: 2, 3iM*5,£D*5£ 

6©jiaa!»c«tt)waistifc$c9iA. B^^cofi^ffl^s 
fisA, s B*wtB-r*to-e*s 0 cct\ ^mms 

A, S Bi:t±fI^fI*fS^f5iB^{uB(c*3^T, fS^ 

[0 0 6 7]**% l*3£Zf2<09mic£*)Wtii2tltt 
££PA. B^ORff^coa^WT^a^tti-rS/c* 

©£iw»sa. s ^(onmcD^xmmt^o co^en 40 

A#6l»CO^T©gftffiS Afe<fctffc9TB75riei]fCOV>T 
O^I/jfBS B^TIEOS (2 3) % (2 4) te«tt)3Sai 
t5 0 dCT'fi 1 *5<£Q*2<r)$aji,t|S|1«{c, 08 

fc^-r g 3 3 mmtiLmx<Dimm<n%mm s a , s b * 

Btii?2>t><Dt?%o 
[0 0 6 8] 

SA=|R(C33)A-C33l ( 2 3) 
SB=|B(C33)B-C33l (2 4) 

^ (2 3) fCfctfSR (G 3 3) A<4 1 <D9BM 

ic&^xa. (i 2) ic^^nm^ntcismg, s (2 50 



10 



30 



So 

B(i 
[0 

l/^T 
Blf 
4b\ 
3(C; 
t<D 
[0 
SA=|B 
SB=|B 
C C " 

(Dm 

TCI 
(B 2 

iRltC 1 
^•So 

s Bt a 
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tLxwmttiiifi. *mf&&mias^xa. s j tk 

«l-Sj = l/2" (nliSM) fcftSJ:^!* 

wmm^feznx^ztztb. tm<djs. (35) <ox. 
oic tr-y hi/7 hzm^-cmmtLTimz'ft? £ t 

[00 8 3] 

B(R44)=(B(R44)A+B(R44)B+1)»1 (3 5) 

1 tr-y h->7h£-£3;:i;%a-fo COJc^t, £§Jtc 
1 fcT-y h->7h S-a-SC tic it). fi*fffi« 1 /2{g£ 10 

nsfcfe, a (34) tmmzmn&fi^T^zciit: 

S (3 5) fCtSVT lJ&ftllSL/T^SO 
[0 0 8 4] ftfc, 02 (a) {CTn-r^^-SB^J©* 

^©H^E?ij(i02 (b) ic7fi-r/\-i3L.mmt&im 

©8tf!Hfcfc^T\ A 77 fi£0 2 (C*5ltSiffiffi±T73 

[0 0 8 5] COiSKLT, ^TOfflfgfiStCfc^T 
RG B^TOfS^flQR, QG, Q B*)M#<E>n3i:, rfi 
IMEJWUH^fi 5 K fci^T, 0 3 fcfctt*£?LiBRffilB 
*T©RG B£^«*ffiH»«c<fc9*BJL , r, Bi^tf 

121 7tC^-tJ;9{i:4 x 4H*{COV^TcD2^:7ECubic 30 

@*4 5m®mwrcffifflm&(omwzGt5ti$m7'( 
±a t rc ± o (c e. n/i^ffi^fistc 3 r c b ft 

*»t«fi^ffl%B[tti-rSj'S:4i><D«KWII"ea6ti{fl^4 40 

[0086] ^>t% m i o«js»»o»ffteoi/^rK 
mrrso 0 1 8 us i <onmBmomft*7Ts-?-7a-i- 

+->T*&S, $t\ LTJJMSC CD 1 fc 

*5t,>TIHir-£S 0£f#3 (X^-y^S 1) „ ^ 

x\ ffim^m2<DGmr$^m3ict3^T, ±e en o 

Uf7 7'S3) > R BlS(S?S4tc43^TRff^QR 50 



1#W 2 0 0 1 - 2 9 2 4 5 5 
24 

tfJMJStl* Uf-y/S 4) o 
[0 0 8 7] 01 giiXx-y^S 4 0J51«St7n- 

ffi^WWL (Xf7 7"S 11), Xx-y7°S 3&J:0*4 
lc«fc9eW5:*tiiL (xf"-y7°S 1 2) , MS 5*3 J: 
0*6tJ;»jM^ffl^ai-r5 (Xf-yys I3).*L 
T, girfMffl^gl 3fcfcl^T, ±IK (2 3) , 

(2 4) mcTiiTZoicmims a. sB^smn 

(X-f-y 7°S 1 4) c ZLX, SMjffiSA. SBfiS* 

mmmm^mi 4icxtiztix, ccxm&mm 

j SIRS ft, Xf'yT'S 11. S 1 2. S 1 3<D 

mmiczQWBiznrdmmtfm&wnmzftx. r 

Ig^QR^HtUSnS (Xx-v7°S 1 5) o 
[0 0 8 8] 02 OltXT-yfS 1 5«J8114St7P 

£3Vffc<9T*&3o 02 OfCfcl^Tii, R4 4B 

jRttHKfeftS B (R4 4) m*§(DWtii%mtt><DX*3b 
Z„ $1\ MiS A, S Bcoa*tOT*fe5^5*Wiaj 
BffSns (Xf7 7S 2 1 ) o Xr-y7 p S 2 1 
tlSt, SA = SB = 0. 5i:LTlf«y h->7h*ffl^ 
T, S (3 5) tC=t0 B (R 4 4) ffl^tfWfflSft* 

(XT77S 2 2) „ 

[0 0 8 9] 

B(R44)=(B(R44)A+B(R44)B+1)»1 (3 5) 
Xf--y7°S 2 1 SA^7SBf*Sfr 
SfrtffflBffStlS UfyT'S 2 3) „ X-r-y 7°S 2 3 
tfmfeZftZt, IK1SA, SBCDM^«01 5©fH 
«A5tca&*ci:A^S j = 1 ££n, Tie<D^ (3 
6) iCcfcDB (R4 4) fl^Wtti^nS (Xf77"S 
2 4) „ 
[0 0 9 0] 

B(R44)=B(R44)B (3 6) 

Xx>y7°S 2 3^5S*n«fc, 3SA^5SBT-S5 
frgfr««PJK«n* (XT^-y^S 2 5) o Xf7 7*S 2 

5tfH£;*n<5£, ^SjfiSA, sbom^«015o 

^A4fCfe5Ci:*^S j =0. 7 5 i:£tu TIB© 
S (3 7) (CiDB (R4 4) ffl^jWfflSn* (Xx 
7 7S 2 6) „ 
[0 0 9 1 ] 

B(R44)=(B(R44)A+3B(R44)B+2)»2 (3 7) 
Xx-y7°S 2 StfS^ft^i:, 5SA^3SBT'$5 
*»S*^W»f«nS (Xrv^S 2 7) „ 7>f77S 2 
7tffS?n§i: > f»ISA, SBQHffittBIl 5© 
RR«A3tCfe6CtfrP,S j =0. 5fc*n» S (3 
5) (CiOB (R44) ft^Wm^nS (Xx-y7S 
2 8) o 

[0 0 9 2] XT77S 2 7^S^?tl5i:, 7SA^ 
S BT?«5^S*^W»f?n5 (Xx-yys 2 9) . X 
f77*S2 9* t S^n«t < MIS a. sB<nm& 
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imi 5(Om®AZlC&5££frZ>S j =0. 2 5£$ 
ft, Tie©^ (3 8) K«fcOB (R4 4) 

fts Uf7/s 3 o) o 

[0 0 9 3] 

B(R44)=(3*B(R44)A+B(R44)B+2)»2 (3 8) 

LT\ 2 9#S£Sft5i:, IfffiS A, 

S BOM^iHl 5c0^tSA UC&SCfcfr&S j =0 
£2ft, TI2©it (3 9) {Ccfc»3B (R4 4) {f^tfUE 
tfJSft-S (Xf'yys 3 1 ) „ 
[0 0 9 4] B(R44)=B(R44)A (3 9) 

018lCl!tK R, B±TOfll^*l|ClULfc^g*^W 
#r£ft Uf-yys 5) , XxyT'S 5^?n/ii 
£{£{±, 7.x-y7S 6Kfel/^T»m-r5fi^%BM^f«: 
t7hU Xf77'S4lClotXf'yyS4, S 5 CD 

o 3i l r b fi^t q b t>mm i ns 0 

[0 0 9 5] 7f7^S 5tftt££tt5£. ^7LH*(4 
HW^CD^TC0il*fig(Cj5^T R G B fl*f Q R, Q 
G, QBtfSHJiSftfcfcLT, mteE»WS5tt3 
V>"C» &jBli|cD{fi§{ifc#LT01 6*51^40 1 7(C 
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aViUM 7-f yU ^ fc J; 3 rfJfe v IE73 sr hj«j**?t o T 
[0 0 9 6] ^LTCftfCiO, 02 (b) fC^T^X 

*aej>jk j:3#fic c d i <D^mmnm^ts^m 
^filfctsits r c b c £#t*£, ±a*{i 

Hfcfcl^T R G Bffi^**fSffiH»#H«r-* S 1 
[00 9 7] ftfc, 01 8 {CTjrf "70-^ + — h CD 7.x 
TV**jft Tfe^Bff^tC-t-y hLTfeckV^ dC9t§£\ 
tfJ -f S fW" B ffl^*> 6> R f§^«c <?J 9 If * b ft § C i: i: 
[0 0 9 8] CCDJ^fc, SKOHJSflgffilckntf, fi 

Dat 1 = I R44-G33 I + I R44-G55 I + I G35-B24 I + | G35-B46 I 
Dat2= | R44-G33 I + | R44-G55 I + I G53-B42 I + | G53-B64 | 
Dat3= I R44-G35 I + | R44-G53 I + I G33-B24 I + I G33-B42 | 
Dat4= | R44-G35 I + I R44-G53 | + | G55-B46 I + I G55-B64 | 
ZCX\ S (4 0) ttfcfllAjSGlfCfc^T, R4 4II 
ttB<0fe±SP^<DX-v->*O€s*flJ*f-r*fcii)flDW*fffiD 

a t izBa?&t,<?yv&*). a (4 1) «*aiA7?i6] 

iCtS^X, R4 4B*&H<&£Tffi#<DX'y'>*0fe*flJ 
mtZrctbWmmDa t 2ZWBi?Zt><DX°2bZ 0 $ 
It. S (4 2) t4£EPB?J|fi](C*5^T, R 4 4 SBsgfi® 
<0&±»»Ox-ys;©fei6¥iJ»r-r5fci6fl!)1'JiKfflD a t 
3£m4j-f3&CQT*&D, S (4 3) ttfcSlBjJftKfe 
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7 h 9 c t ic <t 0 , mmmc xmautfi ?ctwv 

tf-PtSo LfttfoT, *5gB/1^IISS-r5fc46cDgH^ 

[0 0 9 9] ft*, ±|BIB l coHSg^Stcio^Tfi, t" 
•y h v-7 b*m^Tm&Wf1XlW*'n-oX^%t>\ fi* 

w»*fl»aHR*s 1 4 fcfc^T*a£nfcs#tttt«» 

Jta*?8l 5tC43^T, ±15^ (3 3) tC^-Tl*^^ 

[oioo] &^x\ *Rw<Dm2<Dnmmmic-3^x 
ffiaggoR Bffira¥ao«j58%*r«E«rn >y ^ht- 

&-5 0 &*5, 02 1 lC}3t>T0 5 £ffl—<Dffil$.fc-D^X 
U-X -y & -5 fex -y & 5 j&>Sfr%W£T -5 W 

tfzimm<D%mmzm?m%:%mms a, sb^lt 

[0 l 0 1] WJg^gl 0(i, «TcDJ:^(cLTfI^ffi 
^It^-r § fijRtiBtf ^ U-X -y s;ic -5 A>fex -y ^tc 
*Sfr*ffl£T«o 02 2(4* (R) fcitf^ (G) ft> 
6**fex>yS;©tflJ*^1-H> 02 3(4fi*5«fcD*J|*^ 
^S^l^-X-y^cD^J^-rST'fe-So **J» 02 2, 
2 3tt5^T{4, M^ffl*<0©lB^fi[g*eStT'^ 
U ^4aJi(y1-CDiii*(4fS^ffiA ,i 2 5 5T-Si>tCDilLT 

^xmmtZo *-r\ w^¥Si 0^4, rieco^ (4 

0) fr£ (4 3) tCj:D, X-yi/CDffl$rffiDa t 1 ~D 
a t 4£;R46&o 
[0 10 2] 
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(4 0) 
(4 1) 
(4 2) 
(4 3) 

3 It toCDWKrfiD a t 4%jwj-rsfe©"pa&«, 
[0 10 3] @#ffl*«^-r5H^fil[BA^*b-x<yv; 
(Cfe^ii^(4, ±8E ! PJ»fffiDa tl~Dat4©?^ 
fn^ 1 Ott^rffi^hS < «<JA{f , 0 2 3 (Ctk 

ryu-x-yyto^, ±se^e (40) ~ (43) 

l^T»tU«tlSWWffitDa t l~Da t 4{Cfc^T, W 
gDa t lfcitfDa t 2^0 4:45. 
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zmfetzwm&iMffm 2 2 fc^-r * a *&x-y s^fc 

±E ! PJKffiDa t l~Da t 4 <DI^-f ftOffi 
£>*#<&3o LfttfoT, PJBftSDa t l~Da t 4 
©»/MiDmi n*^4M£a6ftfdBfflT£it«U « 
/MlDm i njBWTWTT?***^ t&fc-S, 
Dmin=min(Datl.Dat2,Dat3,Dat4)^T (4 4) 

f-oHsmaiifcyu-x-y i/x$>% t 

Dmin=min(Datl,Dat2.Dat3,Dat4)>T (4 5) 

ffiTOffi^LTti, fl§I^8lf7 hT-a^n^^l 

So 

[0104] m®mwtn^®2 3icis^xit. mizmm 
tti^nso s-f, i feitf 2 offlatj:DJ¥W* nrc%. 

EH A, B*lRlOR^<DS*f5ftt«a*lltB-r«fei6© 

ssmisa. s wnmc-D^xmwtz. n^mn 

££ftfc«£, ^01A7?lRjfc:O^T<D^llf|gS Afeitf 
££PB7jfif;:oi,>T<Dg®jffiS (46), 
(4 7) K.fct>JSar$-S 0 CC-pBl*J:ff20 

mai: 0 8 (c^f g 3 3 H«fuST-©{i mao 

WIS A, S BZMtii?Z>$><DttZ> 0 
[0 10 5] 

SA=|R(G33)A-C33|/(R(G33)A+G33) (4 6) 

SB= I B (G33) B-G33 1 / (B (G33) B+G33) (4 7) 

hhmc, %mms a is^xs^mms b%, 3 (4 6) , 

(4 7) LfciJ: (2 3) , (2 4) tCfctJ 

mats, 

[0 10 6] 

SA=|R(G33)A-C33| 
SB=|B(G33)B-C33| 
#(C, 3*5itf4«fiyilCJ:0!fasnfc^91A. B7? 

fav r s^©s*Mtt^sj[*iwi -r 5 it axDmrnmom 
taicD^xmwtZo 

[0 10 7] t-f. ¥ l J/£HfSH(c£9ftW&StB-f3 40 

frfCO^TOgSjflS M3£.Xf%iWB?ila]lC-O^X<D% 
ftffiS B£TIE<Dxe (4 8) , (4 9) {CiOKtUf 
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*{C^f G 3 sajRffiB-PC^iSOSiiffiJ&UffirSt. 
[0 10 8] 

SA=|B(C35)A-C35|/(B(G35)A+G35) (4 8) 

SB= | R (G35) B-G35 1 / (R (G35) B+G35) (4 9) 

glfrffiS B^S (4 8) , (4 9) 
(2 5) , (2 6) {CiOSmt So 
[0 10 9] 

SA=|B(G35)A-C35| (2 5) 

SB=|R(G35)B-G35| (2 6) 

#fc 5*«fct/6o«iaK«fcojiai*nfc^0iA. btj 
anc-D^xmmt^ 

[0 110] S-f, W£««HK«fcD«#ffi**tii'rs 



£E[1A7? 



iS B^rTaBO^ (50), (51) {£<}; »}fi£tH"f 
•So CCT'li 5 33<fctf6Q#lII£:|RH3ifc:, mi 

2,013 ICtR? B 2 4 ffljRfflMT0{I#«<O$»rfI* 

[0111] 

SA=|B24-C(B24)A|/(B24+G(B24)A) (5 0) 

SB=|B24-G(B24)B|/(B24+G(B24)B) (5 1) 

-7?, nsflHHH «fc o ffl^ffi*»ffi-r sHjts&B* 1 ^ 

IifiSB*S(5 0), (5 1) ®»S*tl8Lfea 

(2 7) , (2 8) \z±K>nm%o 

[0 112] 

SA=|B24-G(B24)A| (2 7) 

SB=|B24-G(B24)B| (2 8) 

CCX\ &X -y i/fc «fc tf -Jf U— X >y v?£> Jf^fC £ g 
USA, S BOJSffi^ffiOSSJCOl^TWWrSo H 
2 4 figlSffi S A , SB ©gaj^&OMSSM-f 5 fc 

a©H"Cfc3o H2 ^gVrfflJMEJUCfel^Ttta (fl 
*§ffi 2 5 5) fc«fc tf H («*§<!# 0 $ fed 0 KiS^ 
fit) O^b— X'y^tf&TSftTVSfcOfc-TS. 
£ C X'it R 4 4 H^C&tt-S B (R4 4) {§#<DSrtHC 
O^TI^fSo ST, £EPA#|SjtCO^T, Tieos 
(5 2) £«fc9 R 4 4HH&10B (R 4 4) A{§^£ 

[0 113] 



§o &*>\ ccTttBts.ta^Oi&JIfcRfiKc, 010* 

B(R44)A=C (R44) A+( (B(G35) A-C35) +(B (G53) A-G53) )/2 

=0+ ( (2-0) + (255-255) ) /2= 1 (5 2) 

ffiU G(R44)A=0, B(C35)A=2. B(G53)A=255T"S K) , C 3) £ «fc ») R 4 4 B^fufiO B (R4 4) 

n€><D{g<DJ?iiilC{i, S (12) « (2 0) {C^-T ck9 -So 

4 1^7tCubicX^7^>M^iH^ffl^fCo [0 115] 
[0 114] ^BlB^fCO^T, (5 50 
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tfj ( B(R44B)=C(R44)B+((B(G33)B-C33)+(B(C55)B-C55))/2 

[0 = 1 03+ ( ( 1 05-0) + ( 1 05-0) ) /2 =208 (5 3) 

Uffi flU G(R44)B=103. B(G33)B=105, B(G55)B = 1051?^. * A, SB*5)<i6, x£ (5 5) fCckSB (R4 4) A 

ft ( 9> Ctl<b<Dm<DmtiilClt, S (1 2) , (20) tB (R4 4) Bte^fc*m#f*ttJtaWT5fci&fl!) 

#3 t"<k94l^7cCubicX^'7-r>'ffiffl»JS*ffli/^Co WtflHfcS 

3(c CO 1 1 6] ^LT, TI2©S (5 4) fCcfcf^KKIS * [0 117] 

->- {c SA= | R44-C (R44) A | / (R44+G (R44) A) = 1 1 -0 1 /( 1 +0) =1 

£■5 SB= I R44-G (R44 ) B I / CR44 +G CR4 4) B) = 1 1 - 1 03 1 / ( 1 + 1 03) = 0 . 98 ( 5 4) 

(7 Sj=SA/(SA+SB)=l/(l+0.98)=0.5 (5 5) 

I2il coj:3KM*^*tflaRs j««*»6ti*i:, TIE©* 10* [0 l l 8] 

cr)S (5 6) fc±DB (R44) ffl***ai-r*. * 

B(R44)=(l-Sj)*B(R44)A+Sj*B(R44)B=0. 5*1+0. 5*208=105 (5 6) 

EH (R4 4) fe#<0«iO{Cjai,>i[T*fe§Ci:*WSL 

l> ° ±CS (5 4), (5 5) iCjtTJ: [0 1 19] ^2£DHJ5Sff^(C*3^T«, ffl|« 

sk:s*<*w*»s j*»hlts (5 6) tciOB *»ta-r*H*fiit*^u-iyi;{c*««^Kti, 

m (R 4 4) fa^O«**i{>*fc*Ofltt4l 0 5fcft*fc (5 4) fC^T^S^BSLT^tWlS A, SB? 

T'i J0*ttOfcfi<4*#, «^**ffi"r*H*ffiBH 20 SA=|R44-G(R44)A| = | 1-01=1 

[ C a^fflslfilitioit^fMWcioT^ S (5 6) fc* 

fffi SB=|R44-G(R44)B| = | 1-1031=102 (5 7) 

tfto, s j 

Sj=SA/(SA+SB)=l/(l+102)=0.01 (5 8) 

C0*3fc*fflSftfcM*ttttfl«S jfcJ:D« ^ B (R 4 4) ffi^fcgtHTSfc. 
-j B(R44)=(l-Sj)*B(R44)A+Sj*B(R44)B=0. 99*1+0. 01*208 = 2. 99 (5 9) 

fc, CfifCfctK B (R4 4) mmtOlZft^mt &*5, ±IHS (4 8) . (4 9) fcOI^Ttt, (B(G3. 

li, ^> *©tt*ftfe*ffitfr«e: +C35)*(R(G35)B+C35)*fHIfLT, TS2©S (4 

[0 1 2 °J fexy^sstwssnfe*^ 8- ) , (4 9' ) tczs&m&s a, sB**ai* 

[( i£ (5 7) (C J; D ^ftjfg S A , S B£»ttJ LT£,{| 30 fcf«fct\, 

tC4 XyS?f*afifc*»t*IB*»ftft**«!a: [0 12 3] 

fz& <%.-DXL$.r>tc$>, ®®t>^gmtj:t><Dt%Zo Lfc SA=|B(C35)A-C35|*(R(C35)B+C35) (4 8') 

&! *"T. I20»ll:fe^tl±, e^ll*©l±J-r5 SB=|R(G35)B-G35|*(B(C35)A+G35) (4 9') 

rcz mmiiLWtf7u-*vz;v&zfr&3Lyi;x-&zMcfc &tt* ±ies (50), (5 n tomtit (B24+< 

SB UT»fflBttSA. SBOHUJ^^gM-rSidKL 24)A)*(B24+G(B24)B)*3|iSLT\ Tlg©^ (5 

/ctcoT'fe^o o'), (5 r ) cj:oaaBi«[SA, sB^nai^ 

hfi [0121] 4*5, £?2£>f|fl&fl^fC:fc^T«\ tf«fcV\, 

fit »a^g2 3fct5<,>T, fex-y^T'&Sif^DggjffiS [0 12 4] 

HI A - S BOSttiti, ±fEj£ (4 6) , (4 7) H(Cj:f) SA=|B24-G(B24)A|*(B24+G(B24)B) (5 0') 

froTVStf. Z-tlZVj&C&^TimWff-SZtlZrc 40 SB=|B24-G(B24)B|*(B24+G(B24)A) (5 1') 

-> wiiiv co«^ giifflsA. sB<oit¥*nEt> fc\ ^2<DHsgmi^»m + a*Wfc{+ni stc^-r 

3; 6ft»fttfM#ftf»*<»ftS j <&*ttifc3atttat\, L/c l<Dnffi&m<DW}ft£m-T*&r>. mi 8fC*3t+57 

¥ ' tfoT, ±§23 (4 6) , (4 7) featC(R(G 7 7"S 4 »Cfctt§fflS©##S*-5fc0?£<5;fcik 

«: 33)A+G33)*(B(G33)B+C33)*£WU TK<05£ (4 CT'(+Xr-y 7S 4 fcfcttSflraWffifflilco^Tfl!: 

4; 6 ' > » (47 ' > SftfflSA. SBttntht MWtZo B2 5ltte0mitBmK.t3tt&mQ*tk 

2: [0 12 2] IBItKfC&JIl fcitf 2£<k*e#ffl<Ojfttl ' 

«« SA=|R(G33)A-G33|*(B(C33)B+G33) (4 6') r-y 7S 4 1 K fflS3fe«fctf 4 £<fc5fi#ttD*tt 

iii SB=|B(C33)B-C33|*(R(C33)A+G33) (4 7') 50 (Xr-v7S 4 2) , «H1 5**0 6 fc«fc 
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[07] m^m(owmmmr^tctb<om (tco 
ess] {mm<Dnmmm?zrcib<D® (fo2) 

[09] ^ffl<0»ttl%ittWrSfciiKOH (^0 3) 

[01 o] mmmnmmwtzrcitxDm an a) 
[0ii] wMrowffl«Kgrr*fctt0Bi c*©5) 

[01 2] fl^fflcDStH^|«B^-r5/c46cO0 (*<D6) 

[01 3] <s^«o»m*ittwr5fc*{)©H (*«7) 

CHl 4] SftiaSA. SBfcBftttttfliftS j £©H 
[0 1 5] to 1 tD^fiii«S«l ; &^-r^/cJ6cO0 

[01 6] <n®iEii7 * >i$<Dm*7Fi-fm (foo 

[017] ffJ*KiE^7-f;U^©flflJ^'r0 (*©2) 
[0 1 8] % 1 <DWM$&(0Wlft*7rs-t7U- c f- J r- V 

[01 9] «*naj&S0»fis£*-f7ci-?-+-h 
[020] tr-y h~>7 h*fflt^a*#ttftnii[«ia<o» 

[02 1] *^£D^2CT)^ff^Ccfc§affiaiigS 

fc^s r Bffira#ao«fig*^-r«iern -y ^0 

[02 2] * (R) fc«fctfli (G) *>e>*5feX-yi/*<0 

^j^-r0 

[02 3] yU-X-y^(7)P^-r0 
[02 4] ^iftfl S A , SB ©Bttitf a<DSiS£Sy!&-r 
5fci6©0 

[0 2 5] £2 0^$ttlC«t*««9JVttffi80ttfr 
[02 6] /N-*AE5iJ©*«CCD«rffll>fcx^^;l'* 
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[02 7] /NX*ABB?U©*ffiC c DlCts^TmZtlfc 
[02 8] X&n-/*7.y<(fr2<DRm%jFitB 

[029] mas a, sb tm^wmm j torn 

[03 0] /nx*aE5IJ^-T0 
[03 1] ^+-EJ"J%^-TH 
[03 2] ^-r*-EM©H*ffiB*#H»**ttLT 
10 ^-f 0 

[03 3] /N^*i»E5«JOii*teB%#!H#^*^LT 
^T0 
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